I’m increasingly skeptical of the assumption that progress in AI reasoning puts us on a path to superintelligence. The expectation of far more powerful AI isn’t imaginary. In his October 2024 essay Machines of Loving Grace, Anthropic’s Dario Amodei described the possibility of a “country of geniuses in a datacenter.” He thought such powerful AIContinue reading “Hyperautomation Doesn’t Need Superintelligence”
Category Archives: Uncategorized
Your AI Safety Score May Be Measuring the Test, Too
Every few months, an AI safety result appears that sounds unsettling. A model realizes it is being evaluated, figures out what the evaluator is looking for, and sometimes behaves differently. The obvious leap is that the model is self-aware, or worse, pretending to behave until the test is over. I don’t think the evidence getsContinue reading “Your AI Safety Score May Be Measuring the Test, Too”
Anthropic Can Keep Claude’s Self-Model. It Should Be Careful What Claude Says About It.
A few weeks ago I wrote that I don’t have much of a problem with saying an AI decided, chose or approved something. If an agent made the intermediate decision, that is often the clearest description of what happened. What bothers me more is designing AI to make it seem as though there is someoneContinue reading “Anthropic Can Keep Claude’s Self-Model. It Should Be Careful What Claude Says About It.”
