RLTasksby ulam.ai
Models / Mistral

Mistral / MODEL EVIDENCE

Magistral Medium 1.2 (09/2025)

10 benchmarks · 11 observations · 11 sources

Scores at a glance

10 benchmarks · large dot: Magistral Medium 1.2 (09/2025); small dots: closest models where reported

LegalBench ↗54.77 %
32.9788.56

Magistral Medium 1.2 (09/2025) · LegalBench · Accuracy ↗

CorpFin v2 ↗47.4 %
28.6373.19

Magistral Medium 1.2 (09/2025) · CorpFin · Accuracy ↗

GPQA Diamond ↗62.37 %
27.0295.45

Magistral Medium 1.2 (09/2025) · GPQA Diamond · Accuracy ↗

MMLU-Pro ↗68.66 %
30.2892.38

Magistral Medium 1.2 (09/2025) · MMLU Pro · Accuracy ↗

MMMU-Pro ↗64.57 %
22.7790.64

Magistral Medium 1.2 (09/2025) · MMMU Pro · Accuracy ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

11.5 percentile-point gap

9 of 10 shared benchmark comparisons

12.3 percentile-point gap

8 of 10 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. AIME — evaluation methodology and results ↗

    Vals AI · 2026

  2. CorpFin — evaluation methodology and results ↗

    Vals AI · 2026

  3. GPQA Diamond — evaluation methodology and results ↗

    Vals AI · 2026

  4. LiveCodeBench — evaluation methodology and results ↗

    Vals AI · 2026

  5. LegalBench — evaluation methodology and results ↗

    Vals AI · 2026

  6. MedQA — evaluation methodology and results ↗

    Vals AI · 2026

  7. MGSM — evaluation methodology and results ↗

    Vals AI · 2026

  8. MMLU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  9. MMMU Pro — evaluation methodology and results ↗

    Vals AI · 2026

  10. MortgageTax — evaluation methodology and results ↗

    Vals AI · 2026

  11. TaxEval — evaluation methodology and results ↗

    Vals AI · 2026

Names used in source tables

Magistral Medium 1.2 (09/2025)