RLTasksby ulam.ai
Models / DeepSeek

DeepSeek / MODEL EVIDENCE

DeepSeek-R1-Distill-Qwen-32B

5 benchmarks · 7 observations · 5 sources · released 2025-01-20

Scores at a glance

5 benchmarks · large dot: DeepSeek-R1-Distill-Qwen-32B; small dots: closest models where reported

GPQA Diamond ↗64.14%
9.2896.4

DeepSeek-R1-Distill-Qwen-32B · GPQA diamond · Best score (across scorers) · % ↗

BALROG ↗19.5%
3.768.3

DeepSeek-R1-Distill-Qwen-32B · Balrog · Average progress · % ↗

LiveBench ↗45.55%
22.0882.35

DeepSeek-R1-Distill-Qwen-32B · LiveBench · Global average · % ↗

UGPhysics ↗36.11%
5.3657.16

DeepSeek-R1-Distill-Qwen-32B · UGPhysics · English · overall accuracy · original evaluation ↗

2 more reported results

27.75% · DeepSeek-R1-Distill-Qwen-32B · UGPhysics · Chinese · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗

31.93% · DeepSeek-R1-Distill-Qwen-32B · UGPhysics · Language average · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

10.2 percentile-point gap

3 of 5 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models — published result table ↗

    Xin Xu, Qiyun Xu, Tong Xiao, Tianhao Chen, Yuchen Yan, Jiaxin Zhang et al. · 2025

    All 9 authors

    Xin Xu, Qiyun Xu, Tong Xiao, Tianhao Chen, Yuchen Yan, Jiaxin Zhang, Shizhe Diao, Can Yang, Yang Wang

  2. BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ↗

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir et al. · 2024

    All 13 authors

    Paglieri, Davide, Cupiał, Bartłomiej, Coward, Samuel, Piterbarg, Ulyana, Wolczyk, Maciej, Khan, Akbir, Pignatelli, Eduardo, Kuciński, Łukasz, Pinto, Lerrel, Fergus, Rob, Foerster, Jakob Nicolaus, Parker-Holder, Jack, Rocktäschel, Tim

  3. GPQA Diamond ↗

    Epoch AI

  4. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  5. LiveBench — model evaluation leaderboard ↗

    LiveBench Team

Names used in source tables

DeepSeek-R1-Distill-Qwen-32B