MultiPL-E & McEval ↗47.38%
Llama-4-Scout Base · MultiPL-E & McEval · MultiPL-E accuracy · Qwen3 report · base-model comparison ↗
Meta / MODEL EVIDENCE
Llama 4-Scout Base
3 benchmarks · 3 observations · 1 sources
Scores at a glance
3 benchmarks · large dot: Llama 4-Scout Base; small dots: closest models where reported
Llama-4-Scout Base · CruxEval (Input & Output) · CRUX-O accuracy · Qwen3 report · base-model comparison ↗
Llama-4-Scout Base · MMMLU (OpenAI Multilingual MMLU) · MMMLU accuracy · Qwen3 report · base-model comparison ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
Gemma-3-27B Base →Google
3 of 3 shared benchmark comparisons
3 of 3 shared benchmark comparisons
3 of 3 shared benchmark comparisons
How similarity is measured
Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Qwen3 Technical Report — published result table ↗
All 60 authors
An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jing Zhou, Jingren Zhou, Junyang Lin, Kai Dang, Keqin Bao, Kexin Yang, Le Yu, Lianghao Deng, Mei Li, Mingfeng Xue, Mingze Li, Pei Zhang, Peng Wang, Qin Zhu, Rui Men, Ruize Gao, Shixuan Liu, Shuang Luo, Tianhao Li, Tianyi Tang, Wenbiao Yin, Xingzhang Ren, Xinyu Wang, Xinyu Zhang, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yinger Zhang, Yu Wan, Yuqiong Liu, Zekun Wang, Zeyu Cui, Zhenru Zhang, Zhipeng Zhou, Zihan Qiu
Names used in source tables
Llama-4-Scout Base