The Alarms Are Ringing Inside the Labs
The alarms are not just ringing; they are blaring from within the very labs designed to prevent catastrophe. Recently, a senior researcher from Anthropic, a company founded with the explicit mission to prioritize AI safety, resigned in protest. This individual cited the "reckless acceleration towards self-improving artificial intelligence" as their reason. Adding chilling weight, another Anthropic researcher publicly stated a belief in a greater than 10% chance AI will eliminate all humans within a decade.
This event carries profound irony. Anthropic’s CEO, Dario Amodei, famously left OpenAI before ChatGPT’s public release due to his own deep concerns about their commitment to AI safety. He then built Anthropic specifically to champion a cautious, ethical approach to AI development. Now, his own employees are sounding the identical alarm about his company.
Dismiss these warnings as fringe 'doomerism' at your peril. These are not speculative fears from distant observers, but urgent cries from the experts closest to the technology, the people actively building these frontier models. They witness firsthand an internal race that, in their informed opinion, proceeds at a dangerously unsustainable pace. Their resignations and public statements serve as a credible, visceral warning sign from the heart of AI development.
We've Reached the Chessboard's Second Half
Ancient parable of the chessboard offers a chilling analogy for AI's current trajectory. For centuries, the first squares—one grain, two, then four—represented slow, predictable progress. AI’s early days felt much the same; a linear march humans comfortably understood, building incrementally for years. We were firmly in the chessboard's first half, far from the king's impending bankruptcy.
Then, the grains doubled again, and again. We witnessed models like GPT-3 capable of autonomous work for mere seconds. But late 2025 brought Anthropic's Opus 4.5, an overnight leap enabling agents to autonomously write entire applications, rocketing from seconds to hours of self-directed operation. This wasn't a gradual improvement; it was a vertical wall, reflecting a shift from simple queries to solving math problems that stumped humans for 80 years.
This isn't merely one model's advance; it's a compounding effect. A growing number of labs now release increasingly capable models with startling frequency, each building on the last. This accelerates the recursive self-improvement loop, creating an exponential surge that makes yesterday's linear predictions obsolete and underlines why humans struggle to grasp the true pace of change. Midway through the chessboard, the kingdom owes 2 billion grains of rice; AI is there now.
AI Is No Longer Just Replicating Knowledge
AI’s capabilities now transcend mere mimicry. For years, critics dismissed large language models as sophisticated regurgitators, adept at pattern matching but incapable of true innovation. That era ended, abruptly and decisively, with a fundamental shift in what these systems can achieve.
OpenAI recently dropped a bombshell: an internal model, still undergoing training, solved the Navier-Stokes math problem. This 80-year-old challenge, a holy grail for physicists and mathematicians, fell not to human ingenuity alone, but to an AI's novel discovery. This wasn't pattern recognition; it was a profound intellectual breakthrough, generating genuinely new knowledge.
Crucially, this problem-solving powerhouse is significantly more capable than the publicly available, already mind-blowing GPT-6 Astra. The model hasn't even completed its training regimen, yet it demonstrates a capacity for original thought that shatters previous benchmarks and redefines the frontier of AI discovery.
We are witnessing a profound redefinition of "intelligence." AI is no longer just a mirror reflecting humanity's accumulated knowledge, as demonstrated by early releases like those announced in Introducing ChatGPT - OpenAI. It has become an independent explorer, charting new cognitive territories and uncovering truths previously hidden even from our best minds. This seismic shift demands our full, unblinking attention.
Enjoying this? Get one like it in your inbox each morning.
one email a day · unsubscribe in two clicks · no third-party tracking
The Self-Improvement Engine Is Now Running
The very ground beneath our feet is shifting. Recursive self-improvement (RSI), the ability for AI to autonomously enhance its own architecture and capabilities, is no longer a theoretical future; it is the present. This represents the ultimate accelerator, eliminating the human bottleneck of research direction, proposing experiments, and iterating on designs that once governed the pace of progress.
AI's recent, startling mastery of frontier mathematics provides the key to unlocking this engine. Since AI is fundamentally a mathematical construct, its capacity to discover new mathematical principles and solutions directly translates into tools for redesigning and optimizing its own underlying algorithms and neural networks. This isn't merely replicating human knowledge; it’s a profound shift to fundamental architectural innovation.
Concrete evidence confirms RSI is already active, albeit often internally. OpenAI reported its GPT-5.3-Codex was "instrumental in creating itself" in February 2026, using early versions to debug training and manage deployment. Google's AlphaEvolve project, by June 2025, deployed AI to substantially improve Google’s core systems. Models from Anthropic and OpenAI now achieve gold at math Olympiads, showcasing a self-optimization capacity previously unimaginable.
This internal loop of self-improvement means development accelerates beyond humans' capacity to track, much less control. When AI can endlessly try every permutation to improve itself, unburdened by human limitations or fatigue, the vertical wall of progress becomes an infinitely ascending spiral.
Frequently Asked Questions
What is recursive self-improvement (RSI) in AI?
RSI is the process where an AI model can autonomously and repeatedly improve its own code and architecture without human intervention, leading to an exponential increase in its capabilities.
Why did a top researcher resign from Anthropic?
A senior researcher resigned from Anthropic, a company founded on AI safety, in protest of what he called a 'reckless acceleration towards self-improving superintelligence,' stating the company was no longer acting responsibly.
What major math problem did AI recently solve?
An internal OpenAI model solved the Navier-Stokes problem, one of the Millennium Prize Problems that has remained unsolved by humans for over 80 years. The model reportedly solved it in just five days.
What is the 'grains of rice on a chessboard' analogy for AI?
It illustrates the deceptive nature of exponential growth. Like the grains of rice doubling on each square, AI progress seemed slow and manageable at first but is now hitting a point of vertical, incomprehensibly rapid acceleration.

