Omni-MATH ↗19.13%
Mathstral-7B-v0.1 · Omni-MATH · Overall accuracy · official leaderboard ↗
Reported model / MODEL EVIDENCE
Mathstral-7B-v0.1
2 benchmarks · 4 observations · 2 sources
Scores at a glance
2 benchmarks · large dot: Mathstral-7B-v0.1; small dots: closest models where reported
UGPhysics ↗17.45%
Mathstral-7B-v0.1 · UGPhysics · English · overall accuracy · original evaluation ↗
2 more reported results
14.8% · Mathstral-7B-v0.1 · UGPhysics · Chinese · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗
16.12% · Mathstral-7B-v0.1 · UGPhysics · Language average · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models — published result table ↗
All 9 authors
Xin Xu, Qiyun Xu, Tong Xiao, Tianhao Chen, Yuchen Yan, Jiaxin Zhang, Shizhe Diao, Can Yang, Yang Wang
- Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models — published result table ↗
All 20 authors
Gao, Bofei, Song, Feifan, Yang, Zhe, Cai, Zefan, Miao, Yibo, Dong, Qingxiu, Li, Lei, Ma, Chenghao, Chen, Liang, Xu, Runxin, Tang, Zhengyang, Wang, Benyou, Zan, Daoguang, Quan, Shanghaoran, Zhang, Ge, Sha, Lei, Zhang, Yichang, Ren, Xuancheng, Liu, Tianyu, Chang, Baobao
Names used in source tables
Mathstral-7B-v0.1