Gemini 2.0 Flash (Dec 2024) · Aider coding benchmarks · Polyglot · percent correct ↗
1 more reported result
22.2% · Gemini 2.0 Flash (Dec 2024) · Aider coding benchmarks · Polyglot · percent correct · Epoch AI · Aider polyglot ↗
Google / MODEL EVIDENCE
6 benchmarks · 9 observations · 6 sources
6 benchmarks · large dot: Gemini 2.0 Flash (Dec 2024); small dots: closest models where reported
Gemini 2.0 Flash (Dec 2024) · Aider coding benchmarks · Polyglot · percent correct ↗
22.2% · Gemini 2.0 Flash (Dec 2024) · Aider coding benchmarks · Polyglot · percent correct · Epoch AI · Aider polyglot ↗
Gemini 2.0 Flash (Dec 2024) · Lech Mazur Writing · Mean rubric score / 10 ↗
Gemini 2.0 Flash (Dec 2024) · MMLU · EM · % ↗
Gemini 2.0 Flash (Dec 2024) · SimpleBench · Score (AVG@5) · % ↗
18.9% · Gemini 2.0 Flash (Dec 2024) · SimpleBench · Score (AVG@5) · % · Epoch AI · SimpleBench ↗
Gemini 2.0 Flash (Dec 2024) · LiveBench · Global average · % ↗
59.26% · Gemini 2.0 Flash (Dec 2024) · LiveBench · Global average · % · Epoch AI · LiveBench ↗
Gemini 2.0 Flash (Dec 2024) · General ECI · 26 October 2026 fit ↗
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
2 of 2 shared benchmark comparisons
2 of 2 shared benchmark comparisons
2 of 2 shared benchmark comparisons
Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
2024-12-06 · 2024-12-11
Gemini 2.0 Flash (Dec 2024)