AI Model Timeline

Tracking the accelerating release frequency of frontier AI models.

Claude 3 Opus

Anthropic·

LLMsflagshipcloud

Overview

Haiku, Sonnet, and Opus models.

Capabilities and innovations

Vision capabilitiesNear-human nuanceOpus reasoningVision CapabilitiesThree-tier Model FamilyNear-human Reasoning

Benchmarks

BenchmarkScoreSource
GPQA Diamond50.4%unsourced
Humanity’s Last Exam (no tools)6.5%unsourced
SWE-bench Verified13.9%unsourced
MMLU86.8%unsourced
  • SWE-bench Pro: benchmark did not exist at release
  • MMLU-Pro: benchmark did not exist at release
  • Terminal-Bench 2.x: benchmark did not exist at release
  • MMMU-Pro: benchmark did not exist at release

Links

More from Anthropic

Data curated by AI Model Timeline. See the methodology for admission criteria, benchmark eras and source priority.