Claude Opus 5.5

Scores at a glance

119 benchmarks · large dot: Claude Opus 5.5; small dots: closest models where reported

833.061811.82

Claude Opus 5.5 (Max, Default Fallback) · AA-Briefcase v1.1 · overall Elo ↗

1 more reported result

1803 Elo · Claude Opus 5.5 (max, with fallback) · AA-Briefcase v1.1 · AA-Briefcase v1.1 (Elo-score) · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

7.432.6

Claude Opus 5.5 (Max, Default Fallback) · GDP.pdf · all-pass ↗

4 more reported results

30.6 · Claude Opus 5.5 (max) · GDP.pdf · Muse Wonder official evaluation report ↗

30.6% · Claude Opus 5.5 (max) · GDP.pdf · GDP.pdf score · % · Epoch AI · GDP.pdf ↗

83.9% · Claude Opus 5.5 (max, with fallback) · GDP.pdf · GDP.pdf w/ python · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

30.6% · Claude Opus 5.5 (max, with fallback) · GDP.pdf · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

067.17

Claude Opus 5.5 (Max, Default Fallback) · Terminal-Bench 4.0 · AA harness ↗

5 more reported results

65.15 % · Claude Opus 5.5 (Mini-SWE-agent) · Terminal-Bench 4.0 · Score · Vals AI · Terminal-Bench 4.0 ↗

66.4% · Opus 5.5 · Terminal-Bench 4.0 · Claude Opus 5.5 launch report ↗

66.4% · Claude Opus 5.5 · Terminal-Bench 4.0 · Gemini 4 Argon model card ↗

59.6 · Claude Opus 5.5 (max) · Terminal-Bench 4.0-AA · Muse Wonder official evaluation report ↗

66.4% · Claude Opus 5.5 (max, with fallback) · Terminal-Bench 4.0 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

063.33

Claude Opus 5.5 (Max, Default Fallback) · Terminal-Bench-Science 0.1 · AA harness ↗

4 more reported results

47.14 % · Claude Opus 5.5 (Mini-SWE-agent) · Terminal-Bench-Science · Score · Vals AI · Terminal-Bench-Science ↗

58.7% · Opus 5.5 · Terminal-Bench-Science 0.1 · Claude Opus 5.5 launch report ↗

63.3% · Claude Opus 5.5 · Terminal-Bench Science 0.1 · Gemini 4 Argon model card ↗

63.3% · Claude Opus 5.5 (max, with fallback) · Terminal-Bench-Science 0.1 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

3.9246.44

Claude Opus 5.5 (Max, Default Fallback) · FrontierCode 2.0 · AA implementation ↗

-8.2748.13

Claude Opus 5.5 (Max, Default Fallback) · AA-Omniscience v1.1 · error-penalized index ↗

1 more reported result

46.42 index · Claude Opus 5.5 (Max, Default Fallback) · AA-Omniscience · error-penalized score · Artificial Analysis ↗

AA-3D ↗1196.40 Elo
572.551198.83

Claude Opus 5.5 (Max, Default Fallback) · AA-3D · Elo ↗

23.7560

Claude Opus 5.5 (Max, Default Fallback) · AA-AnalystAgent · strict score ↗

42.9466.9

Claude Opus 5.5 (Max, Default Fallback) · SciCode · AA implementation ↗

5 more reported results

66.9% · Claude Opus 5.5 (max) · SciCode · Score · % · Epoch AI · SciCode ↗

65.05% · Claude Opus 5.5 (xhigh) · SciCode · Score · % · Epoch AI · SciCode ↗

60.42% · Claude Opus 5.5 (high) · SciCode · Score · % · Epoch AI · SciCode ↗

59.26% · Claude Opus 5.5 (medium) · SciCode · Score · % · Epoch AI · SciCode ↗

58.56% · Claude Opus 5.5 (low) · SciCode · Score · % · Epoch AI · SciCode ↗

30.7261.35

Claude Opus 5.5 (Max, Default Fallback) · Humanity’s Last Exam · AA implementation ↗

3 more reported results

67.7% · tools · Opus 5.5 · Humanity’s Last Exam · tools · Claude Opus 5.5 launch report ↗

67.7% · Claude Opus 5.5 (max, with fallback) · Humanity’s Last Exam · HLE-Full w/ tools · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

59.8% · Claude Opus 5.5 (max, with fallback) · Humanity’s Last Exam · HLE-Full · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

35.2256.21

Claude Opus 5.5 (Max, Default Fallback) · ITBench-AA · root-cause score ↗

73.4787.69

Claude Opus 5.5 (Max, Default Fallback) · MMMU-Pro · AA implementation ↗

2 more reported results

89.8% · Claude Opus 5.5 (max, with fallback) · MMMU-Pro · MMMU-Pro w/ python · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

87.7% · Claude Opus 5.5 (max, with fallback) · MMMU-Pro · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

6.1141.67

Claude Opus 5.5 (Max, Default Fallback) · MLCR-AA · overall ↗

483.14

Claude Opus 5.5 (Max, Default Fallback) · CritPt v2 · code tools ↗

4.5732.86

Claude Opus 5.5 (Max, Default Fallback) · CritPt · original ↗

5 more reported results

31.71% · Claude Opus 5.5 (max) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

31.71% · Claude Opus 5.5 (xhigh) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

30.86% · Claude Opus 5.5 (high) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

27.71% · Claude Opus 5.5 (medium) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

17.71% · Claude Opus 5.5 (low) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

AA-PersonalityBench ↗89.85 percentile
28.92100

Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · expressiveness ↗

7 more reported results

77.15 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · organization · Artificial Analysis ↗

92.38 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · informativeness · Artificial Analysis ↗

89.85 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · transparency · Artificial Analysis ↗

82.23 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · warmth · Artificial Analysis ↗

69.54 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · conviction · Artificial Analysis ↗

94.92 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · imagination · Artificial Analysis ↗

18.77 percentile · Claude Opus 5.5 (Max, Default Fallback) · AA-PersonalityBench · slop · Artificial Analysis ↗

41.757.8

Opus 5.5 · CursorBench 4.0 ↗

5 more reported results

57.8% · Claude Opus 5.5 (max) · CursorBench · Score · % · Epoch AI · CursorBench ↗

56% · Claude Opus 5.5 (xhigh) · CursorBench · Score · % · Epoch AI · CursorBench ↗

56% · Claude Opus 5.5 (high) · CursorBench · Score · % · Epoch AI · CursorBench ↗

52.5% · Claude Opus 5.5 (medium) · CursorBench · Score · % · Epoch AI · CursorBench ↗

43.7% · Claude Opus 5.5 (low) · CursorBench · Score · % · Epoch AI · CursorBench ↗

40.249.3

Claude Opus 5.5 · PostTrainBench ↗

1 more reported result

43.8% · Claude Opus 5.5 (max, with fallback) · PostTrainBench · PostTrain Bench v1.2 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

34.239.5

Claude Opus 5.5 · Agents’ Last Exam · pass rate ↗

2 more reported results

42.6% · Claude Opus 5.5 (max, with fallback) · Agents’ Last Exam · Agents' Last Exam (ALL) · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

40.7% · Claude Opus 5.5 (max, with fallback) · Agents’ Last Exam · Agents' Last Exam (CLI) · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

42.557.5

Claude Opus 5.5 (max) · SWE-Marathon ↗

1 more reported result

46.3% · Claude Opus 5.5 (max, with fallback) · SWE-Marathon · SWE Marathon v1.1 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

STEMBench ↗2.621 / 4
2.172.68

Claude Opus 5.5 · STEMBench120 · mean progress / 4 · closed ↗

2.113.25

Claude Opus 5.5 xhigh · ErdősBench · mean progress / 4 · API ↗

9.2896.4

Claude Opus 5.5 (max) · GPQA diamond · Best score (across scorers) · % ↗

1 more reported result

93.9% · Claude Opus 5.5 (max, with fallback) · GPQA Diamond · GPQA-Diamond · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

076

Claude Opus 5.5 (max) · Chess Puzzles · Best score (across scorers) · % ↗

8.8977.4

Claude Opus 5.5 (max) · MirrorCode · Best score (across scorers) · % ↗

4.3854.05

Claude Opus 5.5 (xhigh) · WeirdML v3 · Max performance · % ↗

025.67

Claude Opus 5.5 (max) · SpireClimb · Best score (across scorers) · % ↗

Vals RSI Index ↗0.46 reference score
00.46

Claude Opus 5.5 (max) · Compression · reference-anchored score ↗

3 more reported results

0.53 reference score · Claude Opus 5.5 (max) · LM training · reference-anchored score · Vals RSI Index · LM training ↗

0.15 reference score · Claude Opus 5.5 (max) · Harness engineering · reference-anchored score · Vals RSI Index · Harness engineering ↗

0.35 reference score · Claude Opus 5.5 (max) · Post-training · reference-anchored score · Vals RSI Index · Post-training ↗

1556

Claude Opus 5.5 · Urgent safety · share of applicable ratings marked fail ↗

2 more reported results

44% · Claude Opus 5.5 · Health advice · share of applicable ratings marked fail · Vals AI · SAFE-Teen ↗

25% · Claude Opus 5.5 · Relationship boundaries · share of applicable ratings marked fail · Vals AI · SAFE-Teen ↗

5.7874.39

claude-opus-5-5 · Scale Labs · Risk elicitation score ↗

36.654.2

Claude Opus 5.5 (max) · FocusBench · score · Meta · Muse Wonder launch · maximum effort ↗

41.273

Claude Opus 5.5 (max, with fallback) · BenchCAD · BenchCAD w/o tools · Kimi K3.1 Pro · complete release comparison ↗

1 more reported result

96.2% · Claude Opus 5.5 (max, with fallback) · BenchCAD · BenchCAD w/ tools · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

45.566.5

Claude Opus 5.5 (max, with fallback) · Kimi Code Bench 3.0 · Kimi Code Bench 3.0 Long-horizon (Internal) · Kimi K3.1 Pro · complete release comparison ↗

90.892.1

Claude Opus 5.5 (max, with fallback) · BrowseComp · Kimi K3.1 Pro · complete release comparison ↗

85.693.8

Claude Opus 5.5 (max, with fallback) · CharXiv · CharXiv (RQ) w/ python · Kimi K3.1 Pro · complete release comparison ↗

1 more reported result

92.1% · Claude Opus 5.5 (max, with fallback) · CharXiv · CharXiv (RQ) · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

92.597.7

Claude Opus 5.5 (max, with fallback) · BabyVision · BabyVision w/ python · Kimi K3.1 Pro · complete release comparison ↗

5163

Claude Opus 5.5 (max, with fallback) · ZeroBench · ZeroBench_main w/ python (pass@5) · Kimi K3.1 Pro · complete release comparison ↗

2 more reported results

35% · Claude Opus 5.5 (max, with fallback) · ZeroBench · ZeroBench_main · avg@5 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

43% · Claude Opus 5.5 (max, with fallback) · ZeroBench · ZeroBench_main · pass@5 · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

31.164.4

Claude Opus 5.5 (max, with fallback) · OfficeQA Pro · OfficeQA Pro v2 ↗

20.844.6

Claude Opus 5.5 (max, with fallback) · HANDBOOK.md · Kimi K3.1 Pro · complete release comparison ↗

11191456

Claude Opus 5.5 (max, with fallback) · DECK-Arena · DECK-Arena (Internal, Elo-score) · Kimi K3.1 Pro · complete release comparison ↗

7181076

Claude Opus 5.5 (max, with fallback) · Design Bench · Design Bench (Internal, Elo-score) · Kimi K3.1 Pro · complete release comparison ↗

5.523.3

Claude Opus 5.5 (max, with fallback) · Kimi Hallucination Benchmark · Kimi Hallu Bench Hard w/ tools (Internal, lower is better) · Kimi K3.1 Pro · complete release comparison ↗

1 more reported result

6.8% · Claude Opus 5.5 (max, with fallback) · Kimi Hallucination Benchmark · Kimi Hallu Bench w/o tools (Internal, lower is better) · Kimi K3.1 Pro · complete release comparison · Introducing Kimi K3.1 Pro ↗

54.4100

Claude Opus 5.5 (max, with fallback) · ExploitBench · Kimi K3.1 Pro · complete release comparison ↗

1542.4

Claude Opus 5.5 (max, with fallback) · ExploitGym · Kimi K3.1 Pro · complete release comparison ↗

1.6712.03

Claude Opus 5.5 · GDPx v1.0 · Overall · intended grading ↗

53 more reported results

11.7% · Claude Opus 5.5 · GDPx v1.0 · Eight-domain subset · intended grading · GDPx v1.0 — SemiAnalysis ↗

17.6% · Claude Opus 5.5 · GDPx v1.0 · Recursive Self-Improvement · intended grading · GDPx v1.0 — SemiAnalysis ↗

4.8% · Claude Opus 5.5 · GDPx v1.0 · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

9.3% · Claude Opus 5.5 · GDPx v1.0 · Cybersecurity · intended grading · GDPx v1.0 — SemiAnalysis ↗

20.5% · Claude Opus 5.5 · GDPx v1.0 · Biology · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Finance · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Legal · intended grading · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · Quant Trading · intended grading · GDPx v1.0 — SemiAnalysis ↗

18.7% · Claude Opus 5.5 · GDPx v1.0 · Hardware Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

16.5% · Claude Opus 5.5 · GDPx v1.0 · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

8.7% · Claude Opus 5.5 · GDPx v1.0 · Alignment · intended grading · GDPx v1.0 — SemiAnalysis ↗

8.9% · Claude Opus 5.5 · GDPx v1.0 · Software Engineering · intended grading · GDPx v1.0 — SemiAnalysis ↗

8.7% · Claude Opus 5.5 · GDPx v1.0 · Aria · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Arcverex · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

5.7% · Claude Opus 5.5 · GDPx v1.0 · Ergodex · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

9.3% · Claude Opus 5.5 · GDPx v1.0 · Arithmetic · Cybersecurity · intended grading · GDPx v1.0 — SemiAnalysis ↗

20.5% · Claude Opus 5.5 · GDPx v1.0 · LatchBio · Biology · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Living Context · Finance · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Chakra · Legal · intended grading · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · Third Moment · Quant Trading · intended grading · GDPx v1.0 — SemiAnalysis ↗

17.6% · Claude Opus 5.5 · GDPx v1.0 · Extrapolate · Recursive Self-Improvement · intended grading · GDPx v1.0 — SemiAnalysis ↗

18.7% · Claude Opus 5.5 · GDPx v1.0 · Beautiful Machines · Hardware Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

16.7% · Claude Opus 5.5 · GDPx v1.0 · ValenceForge · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

16.4% · Claude Opus 5.5 · GDPx v1.0 · Emulated · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

8.7% · Claude Opus 5.5 · GDPx v1.0 · Fleet · Alignment · intended grading · GDPx v1.0 — SemiAnalysis ↗

8.9% · Claude Opus 5.5 · GDPx v1.0 · Datacurve · Software Engineering · intended grading · GDPx v1.0 — SemiAnalysis ↗

22.5% · Claude Opus 5.5 · GDPx v1.0 · Overall · partial credit · GDPx v1.0 — SemiAnalysis ↗

24.9% · Claude Opus 5.5 · GDPx v1.0 · Eight-domain subset · partial credit · GDPx v1.0 — SemiAnalysis ↗

17.6% · Claude Opus 5.5 · GDPx v1.0 · Recursive Self-Improvement · partial credit · GDPx v1.0 — SemiAnalysis ↗

12.1% · Claude Opus 5.5 · GDPx v1.0 · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

11.8% · Claude Opus 5.5 · GDPx v1.0 · Cybersecurity · partial credit · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · Biology · partial credit · GDPx v1.0 — SemiAnalysis ↗

54.6% · Claude Opus 5.5 · GDPx v1.0 · Finance · partial credit · GDPx v1.0 — SemiAnalysis ↗

29.9% · Claude Opus 5.5 · GDPx v1.0 · Legal · partial credit · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · Quant Trading · partial credit · GDPx v1.0 — SemiAnalysis ↗

18.7% · Claude Opus 5.5 · GDPx v1.0 · Hardware Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

30.1% · Claude Opus 5.5 · GDPx v1.0 · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

8.7% · Claude Opus 5.5 · GDPx v1.0 · Alignment · partial credit · GDPx v1.0 — SemiAnalysis ↗

8.9% · Claude Opus 5.5 · GDPx v1.0 · Software Engineering · partial credit · GDPx v1.0 — SemiAnalysis ↗

30.6% · Claude Opus 5.5 · GDPx v1.0 · Aria · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Claude Opus 5.5 · GDPx v1.0 · Arcverex · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

5.7% · Claude Opus 5.5 · GDPx v1.0 · Ergodex · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

11.8% · Claude Opus 5.5 · GDPx v1.0 · Arithmetic · Cybersecurity · partial credit · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · LatchBio · Biology · partial credit · GDPx v1.0 — SemiAnalysis ↗

54.6% · Claude Opus 5.5 · GDPx v1.0 · Living Context · Finance · partial credit · GDPx v1.0 — SemiAnalysis ↗

29.9% · Claude Opus 5.5 · GDPx v1.0 · Chakra · Legal · partial credit · GDPx v1.0 — SemiAnalysis ↗

27.4% · Claude Opus 5.5 · GDPx v1.0 · Third Moment · Quant Trading · partial credit · GDPx v1.0 — SemiAnalysis ↗

17.6% · Claude Opus 5.5 · GDPx v1.0 · Extrapolate · Recursive Self-Improvement · partial credit · GDPx v1.0 — SemiAnalysis ↗

18.7% · Claude Opus 5.5 · GDPx v1.0 · Beautiful Machines · Hardware Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

38.7% · Claude Opus 5.5 · GDPx v1.0 · ValenceForge · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

21.4% · Claude Opus 5.5 · GDPx v1.0 · Emulated · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

8.7% · Claude Opus 5.5 · GDPx v1.0 · Fleet · Alignment · partial credit · GDPx v1.0 — SemiAnalysis ↗

8.9% · Claude Opus 5.5 · GDPx v1.0 · Datacurve · Software Engineering · partial credit · GDPx v1.0 — SemiAnalysis ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

17.0 percentile-point gap

68 of 74 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

About the model report

Effort settings and safeguard fallbacks differ by evaluation. The linked launch and system card disclose those conditions. Reviewed 2026-10-25.

Read the official model report ↗

9 benchmarks in the report

Search this collection →
AGT / BENCHMARK38 reported results

GDPval-AA v2.1

Agents complete occupational work and deliver documents, analyses, and other professional artifacts.

Pairwise Elo↗
COD / BENCHMARK115 reported results

Terminal-Bench 4.0

Complex terminal work spans coding, science, infrastructure, and other technical tasks, with executable checks.

Verified task success↗
SCI / BENCHMARK90 reported results

Terminal-Bench-Science 0.1

Research workflows are completed in a terminal and checked with task-specific tests.

Verified task success↗
COD / BENCHMARK95 reported results

FrontierCode 1.1

Repository-level engineering is evaluated against the standard of work maintainers could accept.

Task success↗
RSN / BENCHMARK131 reported results

Humanity’s Last Exam

Expert-authored questions stretch academic reasoning and knowledge across many disciplines.

Answer accuracy↗
AGT / BENCHMARK13 reported results

OSWorld 2.1

The OSWorld version reported in recent launches measures computer-use agents on extended application workflows.

Partial and binary task score↗
RSN / BENCHMARK17 reported results

Chartography

Specialist charts test visual reasoning grounded in professional practice.

Professional chart accuracy↗
COD / BENCHMARK82 reported results

CursorBench 4.0

An agentic-coding evaluation appears alongside terminal and repository benchmarks in Anthropic’s release.

Agentic coding success↗
AGT / BENCHMARK20 reported results

AutomationBench · Zapier

Business workflows require an agent to coordinate real tools and leave the simulated business systems in the required final state.

Verified final-state success↗

COMPARISON CHECKLIST

Match benchmark version, task subset, model effort, harness, tool access, attempt budget, scoring rule, and fallback behavior. A shared benchmark name is the start of a comparison, not proof that two reported scores use the same contract.

Anthropic original report ↗