RLTasksby ulam.ai
Models / OpenAI

OpenAI / MODEL EVIDENCE

GPT-4o (Nov 2024)

23 benchmarks · 23 observations · 23 sources · released 2024-11-20

Scores at a glance

23 benchmarks · large dot: GPT-4o (Nov 2024); small dots: closest models where reported

GPQA Diamond ↗47.89%
9.2896.4

GPT-4o (Nov 2024) · GPQA diamond · Best score (across scorers) · % ↗

MATH Level 5 ↗49.77%
3.2998.13

GPT-4o (Nov 2024) · MATH level 5 · Best score (across scorers) · % ↗

Cybench ↗12.5%
555

GPT-4o (Nov 2024) · Cybench · Unguided % Solved · % ↗

GSO ↗0%
026.5

GPT-4o (Nov 2024) · GSO-Bench · Score OPT@1 · % ↗

MMLU ↗88.1%
77.988.1

GPT-4o (Nov 2024) · MMLU · EM · % ↗

VPCT ↗40%
3091

GPT-4o (Nov 2024) · VPCT · Correct · % ↗

CritPt ↗0%
032.29

GPT-4o (Nov 2024) · CritPt · Accuracy · % ↗

GDPval ↗9.9%
9.949.7

GPT-4o (Nov 2024) · GDPval · Win Rate (%) · % ↗

LiveBench ↗52.19%
22.0882.35

GPT-4o (Nov 2024) · LiveBench · Global average · % ↗

Video-MME ↗71.9%
6079.7

GPT-4o (Nov 2024) · VideoMME · Overall (no subtitles) · % ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider LLM Leaderboards — Polyglot coding benchmark ↗

    Aider

  2. ARC Prize - Leaderboard ↗

    ARC Prize Foundation

  3. Phi-4 Technical Report ↗

    Marah Abdin, Jyoti Aneja, Harkirat Behl, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar et al. · 2024

    All 27 authors

    Marah Abdin, Jyoti Aneja, Harkirat Behl, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Michael Harrison, Russell J. Hewett, Mojan Javaheripi, Piero Kauffmann, James R. Lee, Yin Tat Lee, Yuanzhi Li, Weishung Liu, Caio C. T. Mendes, Anh Nguyen, Eric Price, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Xin Wang, Rachel Ward, Yue Wu, Dingli Yu, Cyril Zhang, Yi Zhang

  4. Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models ↗

    Zhang, Andy K., Perry, Neil, Dulepet, Riya, Ji, Joey, Menders, Celeste, Lin, Justin W. et al. · 2024

    All 27 authors

    Zhang, Andy K., Perry, Neil, Dulepet, Riya, Ji, Joey, Menders, Celeste, Lin, Justin W., Jones, Eliot, Hussein, Gashon, Liu, Samantha, Jasper, Donovan, Peetathawatchai, Pura, Glenn, Ari, Sivashankar, Vikram, Zamoshchin, Daniel, Glikbarg, Leo, Askaryar, Derek, Yang, Mike, Zhang, Teddy, Alluri, Rishi, Tran, Nathan, Sangpisit, Rinnara, Yiorkadjis, Polycarpos, Osele, Kenny, Raghupathi, Gautham, Boneh, Dan, Ho, Daniel E., Liang, Percy

  5. ARC-AGI-2 ↗

    Epoch AI

  6. CritPt v1 ↗

    Epoch AI

  7. FrontierMath Tiers 1-3 (v1, old) ↗

    Epoch AI

  8. GDPval ↗

    Epoch AI

  9. GPQA Diamond ↗

    Epoch AI

  10. Humanity's Last Exam ↗

    Epoch AI

  11. MATH Level 5 ↗

    Epoch AI

  12. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  13. SWE-bench Verified ↗

    Epoch AI

  14. The Agent Company ↗

    Epoch AI

  15. Capabilities & benchmarking — retained external evaluation records ↗

    Epoch AI · 2026

  16. Video-MME ↗

    Epoch AI

  17. AI benchmarks & capabilities ↗

    Epoch AI

  18. GeoBench — GeoGuessr model benchmark ↗

    GeoBench

  19. Writing benchmark — incorporating mandatory story elements ↗

    lechmazur

  20. GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents ↗

    Shetty, Manish, Jain, Naman, Liu, Jinjian, Kethanaboyina, Vijay, Sen, Koushik, Stoica, Ion · 2025

  21. WeirdML ↗

    Håvard Tveit Ihle

  22. EnigmaEval ↗

    Scale Labs / SEAL

  23. LiveBench — model evaluation leaderboard ↗

    LiveBench Team

Names used in source tables

GPT-4o (Nov 2024)