RLTasksby ulam.ai
Models / Qwen

Qwen / MODEL EVIDENCE

Qwen3-8B

10 benchmarks · 22 observations · 10 sources · released 2025-04-28

Scores at a glance

10 benchmarks · large dot: Qwen3-8B; small dots: closest models where reported

LMCA ↗8.82%
2.7868.26

Qwen3-8B · LMCA · Score · % ↗

RM-Bench ↗75%
59.796

Qwen3-8B · RM-Bench · Overall accuracy · official leaderboard ↗

Biomni-Eval ↗0.318 / 1
0.320.67

Qwen3-8B · Biomni-Eval · Biomni-Eval1 · mean task reward · Biomni-R0 · A1 scaffold and E1 environment ↗

10 more reported results

0.6 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · CRISPR delivery · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.22 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · catalog · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.76 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · OpenTargets · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.72 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · GWAS causal gene · PharmaProjects · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.09 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · GWAS variant prioritization · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.16 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · LAB-Bench DbQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.28 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · LAB-Bench SeqQA · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.02 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · Patient gene detection · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.07 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · Rare disease diagnosis · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

0.26 / 1 · Qwen3-8B · Biomni-Eval · Biomni-Eval1 · Screen gene retrieval · task reward · Biomni-R0 · A1 scaffold and E1 environment · Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

7.4 percentile-point gap

5 of 7 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. SciCode Benchmark | Artificial Analysis ↗

    Artificial Analysis

  2. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  3. LMCA — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  4. CritPt v1 ↗

    Epoch AI

  5. GPQA Diamond ↗

    Epoch AI

  6. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  7. AI benchmarks & capabilities ↗

    Epoch AI

  8. Fiction.liveBench — March 14, 2025 benchmark release ↗

    Fiction.live · 2025

  9. Biomni-R0: Using RL to Hill-Climb Biomedical Reasoning Agents to Expert-Level ↗

    Ryan Li, Kexin Huang, Shiyi Cao, Yuanhao Qu, Jure Leskovec · 2025

  10. RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style — published result table ↗

    Liu, Yantao, Yao, Zijun, Min, Rui, Cao, Yixin, Hou, Lei, Li, Juanzi · 2024

Names used in source tables

Qwen3-8B