Skip to content

model benchmarks

4 articles · Updated

  1. AI Agents ·

    Open AI Models Hit a Brutal Coding Wall

    Promising benchmark scores can make open models look ready to replace frontier AI. But the hidden cost of a coding agent isn’t the token price—it’s what happens when the work keeps going.

  2. AI Research ·

    This 164 MB AI Transcriber Has a Catch

    A tiny download is making heavyweight speech-recognition models look wasteful—and promising to keep recordings off the cloud. But the benchmark that makes Phonon-2 look irresistible leaves some real-world questions unanswered.

  3. AI Research ·

    Phonon-2 Is Tiny. Are Its Whisper Claims Real?

    A new speech model promises hour-long transcriptions in seconds, entirely on your Mac. But the most eye-catching comparison depends on benchmarks that may not be measuring what they seem.

  4. AI Research ·

    The 178MB Speech Model With a Hidden Catch

    The headline speed claim comes with a hardware asterisk, and the accuracy story flips when background noise enters. The more consequential twist is buried in the install command: the weights may be open, but the engine is not.