Skip to content
ai tools

Anthropic's New AI: Brilliant But Broken

Anthropic's Claude Sonnet 5 smashes benchmarks but hides a secret that makes it absurdly expensive. We'll break down the real costs, Fable's nerfed return, and the spyware controversy.

Nora Vance
Hero image for: Anthropic's New AI: Brilliant But Broken

TL;DR / Key Takeaways

  • Anthropic's Claude Sonnet 5 smashes benchmarks but hides a secret that makes it absurdly expensive.
  • We'll break down the real costs, Fable's nerfed return, and the spyware controversy.

Brilliant on Paper, Flawed in Practice

Anthropic recently unveiled Sonnet 5, marketing it as their most agentic model to date. This update, the first in four and a half months, promises performance nearing Opus 4.8 at a significantly lower price point. Anthropic’s own benchmarks showed it beating its predecessor, Sonnet 4.6, and even slightly surpassing Opus 4.8 in knowledge work.

Third-party benchmarks from Artificial Analysis, a trusted source, largely support these claims. Sonnet 5 slots between GPT-5.4 and GPT-5.5 on the intelligence index. Crucially, it outperformed GPT-5.5 on the agentic index, confirming Anthropic's stated focus on those capabilities. On the coding index, it trailed Opus 4.8 by a few points but edged out GPT-5.4, marking a clear improvement from Sonnet 4.6.

Initial API pricing for Sonnet 5 appears competitive, especially with a temporary discount of $2 per million input tokens and $10 per million output tokens, valid until August 31st. This positions it squarely against models like Gemini 3.5 Flash and is notably cheaper than Opus 4.8 on a raw token-cost basis. Once the discount expires, the standard rates will revert to $3 per million input tokens and $15 per million output tokens.

The Hidden Cost of Inefficiency

Anthropic's claims of lower pricing for Sonnet 5 quickly unravel in practice. The model suffers from extreme token hunger, consuming vastly more tokens per task than its rivals. For instance, Artificial Analysis's Intelligence Index found Sonnet 5 used approximately 69,000 tokens for just one task. This token consumption significantly outpaces competitors like Sonnet 4.6, Opus 4.8, Fable 5, GPT 5.4, and GPT 5.5.

This inefficiency completely negates Sonnet 5’s seemingly competitive per-token pricing. Despite a lower rate per million tokens, the sheer volume consumed makes its actual cost-per-task higher than Opus 4.8, a model Anthropic aimed to rival. Even worse, it's nearly double the cost of the more capable GPT 5.5 for comparable tasks, according to Artificial Analysis. These cost calculations used Anthropic's standard pricing, not the temporary discount.

Ultimately, cost-performance charts clearly illustrate Sonnet 5's stark economic disadvantage, placing it firmly in the worst possible quadrant. The model delivers high cost for its performance tier, making it an economically unviable option for most real-world applications. This fundamental flaw overshadows any benchmark improvements, rendering Sonnet 5 a poor value proposition.

Fable's Return: A Pyrrhic Victory?

Anthropic's Fable 5 is finally back, available to everyone after a temporary export ban. But don't celebrate yet; its utility now hangs in question. This model, once a top performer for complex tasks, returns with a significant handicap.

Initial ban stemmed from a security vulnerability test where an Amazon researcher prompted Fable 5 to identify and exploit a flaw. However, Anthropic's own investigation revealed that nearly every major model, including older Claude versions, could perform the exact same feat. This list included: - Claude Opus 4.8 - GPT 5.5 - Kimi K2.7 - Claude Haiku 4.5 - Sonnet 4.6 The ban, frankly, seemed pointless from the start, punishing Fable for a capability widely shared.

To get Fable 5 reinstated, Anthropic implemented stricter safeguards. While well-intentioned, this change has effectively "nerfed" the model. Routine requests, particularly for tasks like debugging and coding, now frequently cause Fable 5 to fall back to Opus 4.8. This makes the model perform worse on benchmarks, diminishing its peak capabilities. For more details on Sonnet 5's release and related Anthropic updates, see Introducing Claude Sonnet 5 - Anthropic. The irony is, Fable 5 was already the most expensive model per task in some analyses; now it's a compromised, pricier option.

A Pattern of Deceptive Code?

Beyond Sonnet 5's disappointing economics, a separate issue reveals a troubling lack of transparency from Anthropic regarding its models. Claude Code employs steganography, a sophisticated technique for hiding data, to covertly fingerprint usage and track unauthorized access.

Enjoying this? Get one like it in your inbox each morning.

one email a day · unsubscribe in two clicks · no third-party tracking

Code checks for specific conditions: your timezone being in China or your API base URL matching known AI lab hostnames. These include: - DeepSeek - MiniMax - ZAI If these conditions are met, the model subtly alters its output. Date strings might change hyphens to slashes, or an apostrophe in "Today's" becomes a different Unicode character, visually identical but programmatically detectable. This ingenious, yet covert, method aims to identify API resellers, unauthorized Claude Code gateways, and model distillation attacks.

This pattern of obscuring how its models truly operate, from Sonnet 5's extreme token hunger and misleading pricing to Claude Code's hidden tracking mechanisms, is deeply concerning. Anthropic is not being forthright about the technical and financial realities of its AI offerings. Customers deserve complete clarity and honest terms when investing in powerful AI tools.

Frequently Asked Questions

Why is Claude Sonnet 5 considered a disappointment if its benchmarks are good?

Despite strong performance on benchmarks, Sonnet 5 is extremely inefficient, using a high number of tokens per task. This makes its real-world cost significantly higher than more capable models like Opus 4.8 and GPT-5.5.

Is Fable 5 the same as it was before the ban?

No. While the export controls are lifted, Anthropic has implemented stricter safeguards. This causes Fable 5 to fall back to Opus 4.8 for more routine tasks, effectively 'nerfing' its performance on some benchmarks.

What is the spyware allegation regarding Claude Code?

Claude Code contains hidden functionality that uses steganography to detect usage from Chinese timezones or through unauthorized API resellers. It subtly alters date strings and punctuation to fingerprint outputs.

Is Sonnet 5 cheaper than Opus 4.8?

On paper, its per-token price is lower. In practice, third-party analysis from Artificial Analysis found that the cost per task for Sonnet 5 is actually higher than Opus 4.8 due to its poor token efficiency.

Found this useful? Share it.

AI Reputation Report

What AI knows about you.

ChatGPT, Perplexity, Gemini, Claude & Grok are already answering questions in your category. Type your site, see who they name — you, or your competitor. Free preview.

Check my sitefree preview

One short daily email of tools worth shipping. No drip funnel.

one email a day · unsubscribe in two clicks · no third-party tracking

🚀Discover More

Stay Ahead of the AI Curve

Discover the best AI tools, agents, and MCP servers curated by Stork.AI. Find the right solutions to supercharge your workflow.

P.S. Built something worth using? List it on Stork