Ask any current AI assistant a geography question and it will answer. Fluently, immediately, in the right format.
It is not looking anything up. A language model predicts text. It has seen the phrase “about a twenty-minute drive” in millions of documents and can produce it on demand, without any mechanism for knowing whether this origin is twenty minutes from that destination. The output is a plausible sentence, not a computed result.
For most questions that’s fine. For a dispatcher deciding which truck goes where, or an operations lead quoting a lane, it isn’t — and the failure mode is that nothing looks broken.
We ran into a sharper version of this with our own geocoder. Asked for “downtown Chicago,” it returned a street in Omaha, Nebraska.
That’s not a defect. “Downtown” isn’t an address. The geocoder tokenised the string, found a street that matched, and returned it with high confidence, because geocoders have no “I don’t know” mode. Their job is to return the best available match, and they always find one.
The failure isn’t imprecision. It’s certainty about the wrong thing, in the right format, 700 kilometres away.
Bart Taborowski