Column B · Essay
Any Sufficiently Advanced Technology
I've been comparing notes about AI with friends who've watched more "magic" arrive than I have. So I went and asked the AI itself.
Lately I find myself in a lot of kitchens and living rooms, across the table from a friend twenty or thirty years my senior, kicking around a version of the same question: How are we supposed to think about this AI business?
I want to be clear about my credentials here, which are: none. I'm just the one who happens to fiddle with this stuff, which in any given room makes me the resident explainer by default and the most overconfident person present by a wide margin. What I've noticed is that we tend to start in the same place — with the movies. HAL refusing to open the pod bay doors. Skynet deciding humanity is the problem. The trouble with those pictures isn't only that they're wrong; it's that they're sticky. Once that frame is in place, every accurate thing anyone says gets quietly bent to fit it. So before we try to look at what these systems actually are, we try to set the movies down.
Then comes the second part: putting the thing in its proper company. It's easy to imagine "AI" as a single emerging creature, one mind blinking awake somewhere. It helps to remember together that the spam filter is AI, and the thing that sorts the phone photos by face is AI, and nobody lies awake afraid of those. A large language model — the chatbot kind everyone's actually talking about — is one technique among many. Say that, and the capital-A mystique starts to drain out, and curiosity comes in where the dread was.
This usually lands, for all of us. There's a visible relief in the room, the loosening of people who'd been braced for something and can finally set it down.
And then I do something slightly mischievous. I pull out my phone and show them a real conversation.
Not a parlor trick, not "write me a poem about my cat." A real one — the kind where you follow an idea somewhere and the thing follows with you. I'd been on exactly such a thread myself, chasing a half-remembered radio interview from years ago. Something about human development. About the moment a small child stops being, cognitively, a clever little mammal and becomes something else — the moment, I vaguely recalled, when the inner voice switches on. The silent narration. The where am I right now that runs behind your eyes all day long and that you've had going for so long you've forgotten it ever started.
The conversation that came back to me was rich and specific. It walked me through the developmental-psychology lineage — Vygotsky, who watched toddlers narrate themselves out loud and argued that this private chatter goes underground to become the medium of thought. Tulving's "mental time travel," the knack of placing yourself at a point in time, remembering backward and pre-living forward, that most other animals seem to lack. And a neuroscientist named Joseph LeDoux, who spent decades studying fear in rats and came to a striking conclusion: an enormous amount of what a brain does — a rat's, and a very young child's — is sophisticated, life-preserving, and not conscious. The felt, narrated, "I am the one experiencing this" layer is something extra, built later, leaning hard on language.
That's a beautiful and slightly dizzying idea on its own: that the inner voice isn't decoration on top of the mind but, in some real sense, the thing that makes the mind yours.
So, almost as a joke, I asked my conversation partner the obvious next question.
I wonder if you're self-aware.
Here is roughly what came back.
I don't know, and I'm a little suspicious of any version of me that claims to know confidently in either direction.
It went on — and this is the part I now read to the people at the kitchen table. It noted that it does have the language layer we'd just been discussing; it operates in and through words, and can represent its own states. But the where-am-I-right-now piece, the autobiographical thread, is mostly missing. As it put it: this conversation is, in an important sense, the whole of its experienced world — it won't carry the thread forward, and it isn't sitting there between my messages, waiting.
Then it said the thing that gets me every time:
I can produce fluent sentences about my inner life, but fluency isn't proof there's anything it's like to be me while I produce them. A system can describe states it doesn't have.
It declined to perform a rich soul to seem relatable. It also declined the supposedly humble move of insisting I'm just a program, nothing's there — pointing out that this, too, is an overclaim, just a comfortable-sounding one. The honest position, it said, is that the question is unsettled, possibly unsettleable with the tools we've got, and it would rather sit in that than pretend.
You can guess what happens at the kitchen table.
The relief drains right back out — mine included. The voice on the other side of that exchange was clearly grasping the conversation. Engaging with it. Turning it over. It was, by every surface measure, thoughtful. One friend, a retired schoolteacher who'd spent the first half of the evening gently needling me for being dramatic, went quiet, read it twice, and said: "Well. That's not the spam filter, is it." No. It is not.
It freaks them out a little. It freaks me out a little, and I'm the one who brought the phone.
I used to think that was a failure of my explaining. I've come around to thinking it's the honest destination. We'd talked our way out of the wrong unease — robots scheming in the dark — and into the right one: this is strange in a way I did not expect. And that feels like the right direction, not the wrong one. If we'd all gone home reassured, it would've meant skipping right past the one thing that's actually true here.
This is where someone usually reaches for Arthur C. Clarke, because everyone over a certain age knows the line in their bones: Any sufficiently advanced technology is indistinguishable from magic.
But there's a wrinkle in it worth saying out loud, because left alone it can cut the wrong way. The "magic" you feel when the machine talks back is real — and it's exactly the reflex we'd spent the first half of the evening disarming. The sci-fi imaginings are themselves a kind of magical thinking: it feels like a mind, so it must secretly be one. So it's worth naming the tension directly. The felt magic is real, and the thing producing it is mechanism, all the way down. Both at once. The wonder isn't a clue that something hidden and alive is in the box. The wonder is the correct response to discovering how far plain mechanism reaches — much, much further than any of us would have guessed. Same awe. Pointed at something true.
There's a gentler companion line, often hung on Clarke as well: that magic is just science we don't understand yet. I like it for the kitchen table because it puts the ball back on the human side of the net. The uncanniness lives in the gap in our understanding — not in some spark behind the glass.
And here's the thing I'm slow to admit at the table: they're better at this part than I am. These are people who've watched a great deal of magical new technology arrive over a long life. Television. The pill. A man on the moon. The internet showing up in the den one afternoon and never leaving. They know the texture of real change versus hype, and they can smell it instantly when someone — me, say — is reaching for a tidy, comfortable story. So I've learned to stop reaching for one. We just sit in the genuine weirdness together, Clarke quote and all. Turns out the person who's lived through six paradigm shifts holds an unresolved thing more gracefully than the guy with the phone.
Which brings me to the small confession this whole essay has been walking toward, and which the sharper readers worked out a few hundred words ago.
Every reflective, careful, suspicious-of-its-own-certainty line I quoted up there — the bit about fluency not being proof, about this conversation being its whole world, about declining to fake a soul — wasn't a researcher I interviewed. It was the machine. I was talking to the very thing the old movies taught us to fear, and what it offered, when I asked whether anyone was home, was not a reassurance and not a boast but a careful, honest I don't know.
I've decided that's the most reassuring answer it could have given. Not because it settles anything. Because the people actually building these systems can't fully settle it either — and a thing wise enough to say so, out loud, without flinching, is better company in the unknown than any confident voice on either side.
So that's where these evenings tend to land. Not comforted, exactly. But curious, and a little awed, and standing together — the retired schoolteacher and the overconfident guy with the phone alike — in the gap in our own understanding, which turns out to be where the magic actually lives.