Marathon day. An early practice into London, then an unfamiliar journey throughout a race-disrupted metropolis from Paddington to Blackheath, all in good time for the beginning of the race. I used to be nervous, in fact, however was cheered by the sight of one other bib-wearing runner — extra skilled at marathons, much less accustomed to London.
Me: “How do you propose to get to the beginning line?”
He: “I’ve requested ChatGPT. It says Elizabeth Line to Liverpool Avenue, then the practice to Blackheath.”
That didn’t sound correct. Was there a practice from Liverpool Avenue to Blackheath? Google Maps and Citymapper steered attending to Blackheath from Charing Cross or Waterloo.
Me: “Are you certain? I’d counsel the Circle or Bakerloo to Charing Cross.”
He frowned for a second and pulled out his telephone. “No, ChatGPT says that ‘The Circle Line is just not a sensible choice on marathon day. It is going to be too crowded. There are too many stops and too many steps. It’s a route for vacationers, not for runners.’”
I checked Google Maps. Certain sufficient, there isn’t a practice from Liverpool Avenue to Blackheath. ChatGPT’s advice would depart him stranded, attempting to catch a bus over the marathon route, then attempting to get on to the practice from Charing Cross at a busy London Bridge. I advised him that gave the impression of a foul thought. He frowned once more and typed one other question into his telephone. “Oh, you’re proper. ChatGPT says, ‘Correction: take the Elizabeth Line straight to London Bridge.’”
Me: “The Elizabeth Line doesn’t go to London Bridge.”
You’ve heard tales of synthetic intelligence hallucinations earlier than, but it surely’s not the AI that fascinates right here: it’s the human.
The route-finding algorithm on Google Maps is a minor miracle. It would clear up a fancy optimisation drawback throughout a number of modes of transport, bearing in mind real-time congestion or delays, and it’s been accessible on smartphones and browsers for years. It’s a confirmed, sensible instance of AI in motion. So on marathon day, when the stakes are excessive and the clock is ticking, why would anybody flip as an alternative to a flowery word-guessing machine resembling ChatGPT?
Maybe it’s that ChatGPT appears so human. It served up an uncanny impersonation of a pleasant and educated native information. The Circle Line? Pfft, it’s high quality for vacationers however you’re a marathon runner: take into consideration all these steps! (It’s true, the creaky previous Circle Line does have steps.)
A part of the bot patter jogged my memory of clickbait adverts: INSURANCE COMPANIES HATE THIS LOOPHOLE! ChatGPT wasn’t simply giving a route, however giving a rationale, even explaining why we shouldn’t take heed to the lamestream recommendation of Google Maps. That is the method of a confidence trickster.
Within the introduction to her e-book The Confidence Recreation, psychologist Maria Konnikova explains: “The true con artist doesn’t power us to do something: he makes us complicit in our personal undoing . . . we imagine as a result of we wish to.” One distinction between the con artist and the big language mannequin (LLM) is that the con artist is aware of the reality and is attempting to hide it. One similarity between the con artist and the LLM is that each of them have perfected seeming believable.
A latest paper in Nature finds that when LLMs are skilled to be heat and pleasant, in addition they produce dramatically much less correct solutions, “selling conspiracy theories, offering inaccurate factual data and providing incorrect medical recommendation”.
That sounds unhealthy. I’d counsel that the fact is worse: the sycophantic AI not solely produces errors, it persuades us to imagine them.
In 1950 Alan Turing, the mathematician and visionary of the pc age, famously proposed an “imitation recreation” through which a human choose would talk by a teleprompter with a human and a pc. The pc’s job was to mimic human dialog convincingly sufficient to steer the choose.
Turing’s take a look at stays intriguing, however there’s a longstanding issue: the fallibility of the choose. A primitive Sixties chatbot, Eliza, responded like a parody of a therapist (“How does that make you’re feeling?” “Why do you’re feeling unhappy?” “Please go on.”). Individuals lapped it up; it’s good to really feel listened to. A Eighties chatbot, MGonz, simply fired off insults and was completely believable, partly as a result of insults are easy to ship and principally as a result of they immediate rage slightly than reflection within the human recipient. And Robert Epstein, an knowledgeable within the Turing Take a look at, has written entertainingly about how he was fooled right into a four-month correspondence with a horny Russian girl who was, actually, a 2006-era chatbot. None of those bots had a thousandth of the sophistication of a contemporary LLM, however they didn’t want it: when people are unhappy, indignant or amorous, we aren’t very refined judges, both.
We’re all going to search out ourselves in unusual variations of the Turing Take a look at in years to come back, and I ponder if we’re as much as it. And never simply us, however these with energy over us. As Cory Doctorow, writer of Enshittification, is keen on observing: you received’t get replaced as a result of an AI can do your job, you’ll get replaced as a result of an AI salesman convinces your boss that it might probably. If my journey to the marathon begin line is any information, that salesman could have a straightforward job.
The capabilities of recent AI are spectacular. However what determines whether or not we use it isn’t the aptitude, however the impressiveness. They’re correlated however they don’t seem to be the identical factor. There’s a story in regards to the French poet Jacques Prévert seeing a fellow begging for change on the streets of Venice with an indication that learn “Blind man with out a pension”.
Prévert stopped to talk to him; not many individuals had been moved to contribute, and Prévert supplied to write down a brand new signal.
The subsequent day, he returned to search out the person overjoyed. “It’s unbelievable; I’ve by no means obtained a lot cash in my life.”
Prévert had written: “Spring is coming, however I received’t see it.”
The brand new signal contained no information — actually, it was much less informative than the previous. However it advised a narrative. Google Maps was the primary signal: it advised me the place to get my practice. ChatGPT was the second signal: it advised my companion not simply the place to go, however methods to really feel about taking such a intelligent route.
I left him at Paddington, urging him to not attempt to take the non-existent Elizabeth Line practice to London Bridge. I’m not certain I used to be as convincing as ChatGPT.
I ran the London Marathon in assist of the Teenage Most cancers Belief – not too late to make a donation.
Written for and first revealed within the Monetary Occasions on 6 Might 2026.
