RLTasksby ulam.ai
Models / Mistral

Mistral / MODEL EVIDENCE

Mistral 7B v0.3

6 benchmarks · 8 observations · 6 sources

Scores at a glance

6 benchmarks · large dot: Mistral 7B v0.3; small dots: closest models where reported

MMLU ↗59.9%
29.587.3

Mistral 7B v0.3 · MMLU · EM · % ↗

DTBench ↗42.54%
41.6598.93

Mistral 7B v0.3 · DTBench · Accuracy · % ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

7.9 percentile-point gap

3 of 3 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  2. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

  3. GPQA Diamond ↗

    Epoch AI

  4. MATH Level 5 ↗

    Epoch AI

  5. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  6. AI benchmarks & capabilities ↗

    Epoch AI

Release dates reported by sources

2023-09-27 · 2024-05-27

Names used in source tables

Mistral 7B v0.3