RLTasksby ulam.ai
Models / Qwen

Qwen / MODEL EVIDENCE

Qwen3-32B

10 benchmarks · 23 observations · 11 sources

Scores at a glance

10 benchmarks · large dot: Qwen3-32B; small dots: closest models where reported

LMCA ↗17.28%
2.7868.26

Qwen3-32B · LMCA · Score · % ↗

Biomni-Eval ↗0.346 / 1
0.320.67

Qwen3-32B · Biomni-Eval · Biomni-Eval1 · mean task reward · Biomni-R0 · A1 scaffold and E1 environment ↗

10 more reported results

0.7 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · CRISPR delivery · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.2 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · catalog · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.7 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · OpenTargets · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.62 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · PharmaProjects · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.16 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · GWAS variant prioritization · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.2 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · LAB-Bench DbQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.52 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · LAB-Bench SeqQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.06 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · Patient gene detection · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.03 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · Rare disease diagnosis · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.26 / 1 · Qwen3-32B · Biomni-Eval · Biomni-Eval1 · Screen gene retrieval · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

11.0 percentile-point gap

5 of 7 shared benchmark comparisons

15.5 percentile-point gap

6 of 7 shared benchmark comparisons

15.6 percentile-point gap

5 of 7 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Aider code editing benchmark ↗

    Paul Gauthier, Aider contributors

  2. Aider LLM Leaderboards — Polyglot coding benchmark ↗

    Aider

  3. SciCode Benchmark | Artificial Analysis ↗

    Artificial Analysis

  4. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  5. LMCA — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  6. CritPt v1 ↗

    Epoch AI

  7. GPQA Diamond ↗

    Epoch AI

  8. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  9. AI benchmarks & capabilities ↗

    Epoch AI

  10. Fiction.liveBench — March 14, 2025 benchmark release ↗

    Fiction.live · 2025

  11. Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

    Ryan Li, Kexin Huang, Shiyi Cao, Yuanhao Qu, Jure Leskovec · 2025

Release dates reported by sources

2025-04-28 · 2025-04-29

Names used in source tables

Qwen3 32B · Qwen3-32B