4 September 2026

AI model solves visual puzzle benchmark faster than expected

First reported

Latent Space ran this on .

  • Astra, a new AI system from Anthropic, scored 63 percent on ARC-AGI-3, a test measuring how well AI systems solve novel visual puzzles that humans find moderately difficult.
  • The benchmark's creator, François Chollet, observed that AI performance jumped from nearly zero to complete mastery in six months, roughly twice as fast as he predicted when designing the test.

How it was covered