RLTasksby ulam.ai
Models / Meta

Meta / MODEL EVIDENCE

Llama 4 Maverick

43 benchmarks · 65 observations · 44 sources

Scores at a glance

43 benchmarks · large dot: Llama 4 Maverick; small dots: closest models where reported

LMCA ↗15.87%
2.7868.26

Llama 4 Maverick · LMCA · Score · % ↗

DTBench ↗61.87%
41.6598.93

Llama 4 Maverick · DTBench · Accuracy · % ↗

SciCode ↗31.71%
1.2766.9

Llama 4 Maverick · SciCode · Score · % ↗

MedCode ↗36.51 %
19.7263.57

Llama 4 Maverick · MedCode · Accuracy ↗

Fortress ↗40.09%
5.7874.39

Llama 4 Maverick · Scale Labs · Risk elicitation score ↗

VISTA ↗38.33%
15.1854.65

Llama 4 Maverick · Scale Labs · Score ↗

HealthBench Hard ↗0%
032

Llama 4 Maverick · HealthBench Hard · Weighted rubric score · original model comparison ↗

LiveCodeBench Pro ↗634 Elo
1999

Llama 4 Maverick · LiveCodeBench Pro · Elo rating · human contest calibration ↗

3 more reported results

0% · Llama 4 Maverick · LiveCodeBench Pro · Hard · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

0% · Llama 4 Maverick · LiveCodeBench Pro · Medium · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

15.5% · Llama 4 Maverick · LiveCodeBench Pro · Easy · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

GAIA-2 ↗13.8%
7.169.2

Llama 4 Maverick · GAIA-2 · Gaia2 full · Execution pass@1 · baseline ReAct · three runs ↗

7 more reported results

14.4% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Search pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

2.1% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Ambiguity pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

5% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Adaptability pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

1.2% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Time pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

6.2% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Noise pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

9.2% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Agent2Agent pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

7.4% · Llama 4 Maverick · GAIA-2 · Gaia2 full · Overall pass@1 · baseline ReAct · three runs · Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments ↗

CyberSecEval ↗28.57%
22.9933.51

Llama 4 Maverick · CyberSecEval · CyberSOCEval · malware analysis · Overall accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison ↗

8 more reported results

31% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · malware analysis · Easy accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

21% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · malware analysis · Medium accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

18% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · malware analysis · Hard accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

50.42% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · threat intelligence · image input · Overall accuracy · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

73% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · threat intelligence · image input · NSA reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

52% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · threat intelligence · image input · CrowdStrike reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

48% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · threat intelligence · image input · IC3 reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

42% · Llama 4 Maverick · CyberSecEval · CyberSOCEval · threat intelligence · image input · CISA reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

ALE-Bench ↗172.97 Performance points
137.782951.32

llama-4-maverick · Average contest performance ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider code editing benchmark ↗

    Paul Gauthier, Aider contributors

  2. Aider LLM Leaderboards — Polyglot coding benchmark ↗

    Aider

  3. ARC Prize - Leaderboard ↗

    ARC Prize Foundation

  4. SciCode Benchmark | Artificial Analysis ↗

    Artificial Analysis

  5. SpatialViz-Bench: A Cognitively-Grounded Benchmark for Diagnosing Spatial Visualization in MLLMs ↗

    Wang, Siting, Pei, Minnan, Sun, Luoyang, Deng, Cheng, Li, Yuchen, Shao, Kun et al. · 2025

    All 9 authors

    Wang, Siting, Pei, Minnan, Sun, Luoyang, Deng, Cheng, Li, Yuchen, Shao, Kun, Tian, Zheng, Zhang, Haifeng, Wang, Jun

  6. HealthBench: Evaluating Large Language Models Towards Improved Human Health — published result table ↗

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos et al. · 2025

    All 12 authors

    Arora, Rahul K., Wei, Jason, Hicks, Rebecca Soskin, Bowman, Preston, Quiñonero-Candela, Joaquin, Tsimpourlas, Foivos, Sharman, Michael, Shah, Meghan, Vallone, Andrea, Beutel, Alex, Heidecke, Johannes, Singhal, Karan

  7. LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? — published result table ↗

    Zihan Zheng, Zerui Cheng, Zeyu Shen, Shang Zhou, Kaiyuan Liu, Hansen He et al. · 2025

    All 19 authors

    Zihan Zheng, Zerui Cheng, Zeyu Shen, Shang Zhou, Kaiyuan Liu, Hansen He, Dongruixuan Li, Stanley Wei, Hangyi Hao, Jianzhu Yao, Peiyao Sheng, Zixuan Wang, Wenhao Chai, Aleksandra Korolova, Peter Henderson, Sanjeev Arora, Pramod Viswanath, Jingbo Shang, Saining Xie

  8. TextQuests: How Good are LLMs at Text-Based Video Games? — published result table ↗

    Phan, Long, Mazeika, Mantas, Zou, Andy, Hendrycks, Dan · 2025

  9. CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning — published result table ↗

    Deason, Lauren, Bali, Adam, Bejean, Ciprian, Bolocan, Diana, Crnkovich, James, Croitoru, Ioana et al. · 2025

    All 23 authors

    Deason, Lauren, Bali, Adam, Bejean, Ciprian, Bolocan, Diana, Crnkovich, James, Croitoru, Ioana, Durai, Krishna, Midler, Chase, Miron, Calin, Molnar, David, Moon, Brad, Ostarcevic, Bruno, Peltea, Alberto, Rosenberg, Matt, Sandu, Catalin, Saputkin, Arthur, Shah, Sagar, Stan, Daniel, Szocs, Ernest, Wan, Shengye, Whitman, Spencer, Krasser, Sven, Saxe, Joshua

  10. Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments — published result table ↗

    Froger, Romain, Andrews, Pierre, Bettini, Matteo, Budhiraja, Amar, Cabral, Ricardo Silveira, Do, Virginie et al. · 2026

    All 24 authors

    Froger, Romain, Andrews, Pierre, Bettini, Matteo, Budhiraja, Amar, Cabral, Ricardo Silveira, Do, Virginie, Garreau, Emilien, Gaya, Jean-Baptiste, Laurençon, Hugo, Lecanu, Maxime, Malkan, Kunal, Mekala, Dheeraj, Ménard, Pierre, Bertran, Gerard Moreno-Torres, Piterbarg, Ulyana, Plekhanov, Mikhail, Rita, Mathieu, Rusakov, Andrey, Vorotilov, Vladislav, Wang, Mengjue, Yu, Ian, Benhalloum, Amine, Mialon, Grégoire, Scialom, Thomas

  11. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  12. LMCA — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  13. Ale Bench — methodology and published results ↗

    Epoch AI · 2026

  14. ARC-AGI-2 ↗

    Epoch AI

  15. CritPt v1 ↗

    Epoch AI

  16. Humanity's Last Exam ↗

    Epoch AI

  17. SimpleBench ↗

    Epoch AI

  18. AI benchmarks & capabilities ↗

    Epoch AI

  19. Fiction.liveBench — March 14, 2025 benchmark release ↗

    Fiction.live · 2025

  20. GeoBench — GeoGuessr model benchmark ↗

    GeoBench

  21. Writing benchmark — incorporating mandatory story elements ↗

    lechmazur

  22. WeirdML ↗

    Håvard Tveit Ihle

  23. DistressBench — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  24. EnigmaEval ↗

    Scale Labs / SEAL

  25. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  26. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  27. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  28. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  29. AIME — evaluation methodology and results ↗

    Vals AI · 2026

  30. CorpFin — evaluation methodology and results ↗

    Vals AI · 2026

  31. GPQA Diamond — evaluation methodology and results ↗

    Vals AI · 2026

  32. LiveCodeBench — evaluation methodology and results ↗

    Vals AI · 2026

  33. LegalBench — evaluation methodology and results ↗

    Vals AI · 2026

  34. MATH 500 — evaluation methodology and results ↗

    Vals AI · 2026

  35. MedCode — evaluation methodology and results ↗

    Vals AI · 2026

  36. MedQA — evaluation methodology and results ↗

    Vals AI · 2026

  37. MedScribe — evaluation methodology and results ↗

    Vals AI · 2026

  38. MGSM — evaluation methodology and results ↗

    Vals AI · 2026

  39. MMLU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  40. MMMU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  41. MortgageTax — evaluation methodology and results ↗

    Vals AI · 2026

  42. Poker Agent — evaluation methodology and results ↗

    Vals AI · 2026

  43. SAGE — evaluation methodology and results ↗

    Vals AI · 2026

  44. TaxEval — evaluation methodology and results ↗

    Vals AI · 2026

Release dates reported by sources

2025-04-05 · 2025-04-06

Names used in source tables

Llama 4 Maverick · llama-4-maverick · llama4-maverick