RLTasksby ulam.ai
Models / Google

Google / MODEL EVIDENCE

gemini-2.5-flash*

10 benchmarks · 16 observations · 11 sources

Scores at a glance

10 benchmarks · large dot: gemini-2.5-flash*; small dots: closest models where reported

LiveCodeBench Pro ↗1 Elo
1999

Gemini 2.5 Flash · LiveCodeBench Pro · Elo rating · human contest calibration ↗

3 more reported results

0% · Gemini 2.5 Flash · LiveCodeBench Pro · Hard · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

12.7% · Gemini 2.5 Flash · LiveCodeBench Pro · Medium · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

47.9% · Gemini 2.5 Flash · LiveCodeBench Pro · Easy · pass@1 · difficulty breakdown · LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? ↗

EconBench ↗19.0234 error points
19.0219.02

gemini-2.5-flash · EconBench · EconBench prototype · risk-consistency error · published prototype observations ↗

ForecastBench ↗62.9 Brier index
46.467

gemini-2.5-flash† · Overall difficulty-adjusted Brier index ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. SealQA: Raising the Bar for Reasoning in Search-Augmented Language Models — published result table ↗

    Pham, Thinh, Nguyen, Nguyen, Zunjare, Pratibha, Chen, Weiyuan, Tseng, Yu-Min, Vu, Tu · 2025

  2. LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming? — published result table ↗

    Zihan Zheng, Zerui Cheng, Zeyu Shen, Shang Zhou, Kaiyuan Liu, Hansen He et al. · 2025

    All 19 authors

    Zihan Zheng, Zerui Cheng, Zeyu Shen, Shang Zhou, Kaiyuan Liu, Hansen He, Dongruixuan Li, Stanley Wei, Hangyi Hao, Jianzhu Yao, Peiyao Sheng, Zixuan Wang, Wenhao Chai, Aleksandra Korolova, Peter Henderson, Sanjeev Arora, Pramod Viswanath, Jingbo Shang, Saining Xie

  3. TextQuests: How Good are LLMs at Text-Based Video Games? — published result table ↗

    Phan, Long, Mazeika, Mantas, Zou, Andy, Hendrycks, Dan · 2025

  4. CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers — published result table ↗

    Pan, Haining, Roggeveen, James V., Berg, Erez, Carrasquilla, Juan, Chowdhury, Debanjan, Ganguli, Surya et al. · 2025

    All 19 authors

    Pan, Haining, Roggeveen, James V., Berg, Erez, Carrasquilla, Juan, Chowdhury, Debanjan, Ganguli, Surya, Ghimenti, Federico, Hasik, Juraj, Hunt, Henry, Jiang, Hong-Chen, Kamb, Mason, Kao, Ying-Jer, Khatami, Ehsan, Lawler, Michael J., Luo, Di, Neupert, Titus, Qi, Xiaoliang, Brenner, Michael P., Kim, Eun-Ah

  5. EconBench: Economic choice by language models — gemini-2.5-flash prototype metrics ↗

    EconBench project · 2026

  6. Forecastbench — methodology and published results ↗

    Epoch AI · 2026

  7. Vending Bench 2 — methodology and published results ↗

    Epoch AI · 2026

  8. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  9. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  10. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  11. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

Names used in source tables

Gemini 2.5 Flash · gemini-2.5-flash · gemini-2.5-flash (Thinking) · gemini-2.5-flash* · gemini-2.5-flash†