RLTasksby ulam.ai
Models / Google

Google / MODEL EVIDENCE

gemini-2.5-flash-lite-preview-06-17

4 benchmarks · 4 observations · 4 sources · released 2025-06-17

Scores at a glance

4 benchmarks · large dot: gemini-2.5-flash-lite-preview-06-17; small dots: closest models where reported

Fiction.liveBench ↗47.2%
2597.2

gemini-2.5-flash-lite-preview-06-17 (Default thinking length) · Fiction.LiveBench · 16k token score · % ↗

WeirdML (v2) ↗35.22%
15.9787.85

gemini-2.5-flash-lite-preview-06-17 (Default thinking length) · WeirdML · Accuracy · % ↗

LMCA ↗18.07%
2.7868.26

gemini-2.5-flash-lite-preview-06-17 (Default thinking length) · LMCA · Score · % ↗

DTBench ↗62.83%
41.6598.93

gemini-2.5-flash-lite-preview-06-17 (Default thinking length) · DTBench · Accuracy · % ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

4.5 percentile-point gap

3 of 4 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  2. LMCA — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  3. WeirdML (v2) ↗

    Epoch AI

  4. Fiction.liveBench — March 14, 2025 benchmark release ↗

    Fiction.live · 2025

Names used in source tables

gemini-2.5-flash-lite-preview-06-17 (Default thinking length)