AI that “reasons”: five key questions

They take time to think before answering, chain steps and use tools. What that changes — and what it does not.

TopNewsDigest2 min read
Illustration: generative AI models

For two years a new generation of language models has dominated the trends: those that “reason”. The term is confusing, and spectacular demos do not help clarify what actually changes. Here are five questions to see clearly, without jargon and without promises.

1. What changes compared with classic models? A classic model produces its answer in one pass, word after word. A so-called reasoning model first generates a series of intermediate steps — break down the problem, try a path, check, correct — before formulating its final answer. That phase consumes compute, hence slower and costlier answers, but markedly more reliable ones on multi-step problems.

2. Does the model really “understand”? There is no scientific consensus on that word applied to a machine. What is measured is performance on specific tasks: maths, programming, planning, standardised exams. It improves noticeably from one generation to the next, but remains uneven, sensitive to how a question is phrased, and sometimes disappointing on problems a human finds simple.

3. What are “agents”? They are the same models connected to tools: web browsing, code execution, access to files, to an inbox or to business applications. The model decides which tool to call, observes the result and chains actions, sometimes over minutes or hours. It is this ability to act, not the quality of the text alone, that fuels talk of automating entire tasks.

4. What are the concrete risks? Plausible errors stated with confidence — often called “hallucinations” — have not gone away: they are rarer but harder to spot, because the reasoning on display looks solid. An agent that acts can therefore act wrongly, sending a message, changing a file or spending money. Add the confidentiality of data sent to the provider, usage costs that are hard to forecast, and dependence on a handful of players.

5. What should you actually do? Start with low-risk, verifiable tasks; keep a human in the loop for any decision involving money, law or people; always ask for sources and check them; and read the terms of use before sending sensitive data, including your customers’.

On the legal side, several jurisdictions are gradually imposing transparency obligations about generated content and about using automated systems for important decisions. These rules are moving fast: check the law that applies to your sector rather than relying on a summary, including this one.

Takeaway: announcements arrive at a pace that discourages serious evaluation. The uses that last are not the most impressive in a demo, but those tested on real cases, with a measured error rate and a clear plan for what happens when the system gets it wrong.