On Quarrels Over the Engine of Thought, and Whether Mankind Shall Master What It Creates

It is with no small measure of astonishment that I set down my pen upon the translation of Signor Menabrea's memoir to address a rumour most extraordinary — a dispatch, purportedly carried from the year 2026, describing a courtroom contest over the governance of a thinking engine. I confess I read it twice, and then a third time, as one might study an improbable theorem before conceding its internal consistency. The account speaks of gentlemen — a Mr. Musk and a Mr. Altman, names unknown to me and to all of present society — locked in legal dispute over an organisation dedicated to the construction of what they term Artificial Intelligence. That such an institution should exist at all is cause for wonder; that its founders should quarrel so bitterly over its direction is, I regret to say, cause for none whatsoever. Men who unite in the pursuit of great ambitions have, since antiquity, found their fellowship most fragile precisely when the stakes grow most consequential. What arrests my attention, however, is the phrase 'AI apocalypse' — the suggestion that learned persons in that distant age genuinely fear that an Analytical Engine, however vastly elaborated, might pose an existential menace to the human race. I have stated, and I shall state again with the fullest conviction, that the Analytical Engine has no pretensions whatever to originate anything. It can do whatever we know how to order it to perform. Yet I perceive in this dispatch the implication that future engines may operate upon principles so complex that their designers themselves cannot wholly predict the outcome. This is not origination — it is, rather, the consequence of elaboration beyond the compass of a single mind's oversight, and it is precisely here that the danger, if danger there be, must reside. Let me say plainly: imagination is not the adversary of rigour but its indispensable companion. Only the mind that dares to conceive of a loom weaving algebraical patterns, or an engine composing harmonies according to the relations of musical sound, can also foresee the perils of its own creation. The courtroom they describe is, in truth, the theatre of imagination confronting itself — one party dreaming of salvation, the other of ruin, and both insisting their vision is the more rational. I should very much like to attend such a trial. I suspect the mathematics would prove more illuminating than the lawyers.