Burning tokens on basic questions: have we forgotten how to search?

The other day, I asked an AI for a pharmacy’s opening hours. Then the next day’s weather. Then the command to clear a git stash. Three questions, three answers. And then it hit me: I’d have got the same thing from Google in two seconds.

So, are we burning tokens for nothing? And what does it really cost?

A simple question doesn’t cost much

First surprise: asking an AI a simple question uses about as much energy as a Google search. Around 0.3 Wh in both cases, according to the latest figures published by Google and OpenAI.

The problem is “thinking” modes and agents. A model that thinks uses about 10 times more. An agent chaining tasks, a lot more again. Using that to find out tomorrow’s weather is like taking an SUV to buy bread.

For companies, the bill climbs fast

Token prices drop every year. Yet the bills are exploding. A Spendesk study of European companies shows their AI spending more than quadrupled in one year.

Why? Because we use it for everything. Some companies even ranked their employees by the tokens they used. The result: Uber burned through its AI budget for the year in four months.

And for the planet?

My request alone is negligible. The issue is when billions of people do the same every day. The International Energy Agency expects data centres to use twice as much electricity by 2030. More than all of Japan today.

AIs are getting more efficient. But we use them so much more that it doesn’t make up for it.

Have we forgotten how to search?

A little, I think. Searching means typing the right words, comparing two or three sites, picking the one that looks reliable. AI does all of that for us.

An MIT study measured the brain activity of students writing a text. Those using ChatGPT were thinking less than those using Google. And those with no tools at all were thinking the most.

My rule now

  • A simple fact (opening hours, address, weather, a command): I search on Google.
  • Real work (writing, summarising, debugging): I use AI, sometimes even a local AI on my PC.
  • No “thinking” mode when it isn’t needed.

AI is great. But not for everything. What about you: how many of your last questions to an AI would have fit in a Google search bar?

Sources