Mistral Large 2 (2407) · Aider coding benchmarks · Refactoring · percent correct ↗
Mistral / MODEL EVIDENCE
Mistral Large 2 (2407)
2 benchmarks · 7 observations · 2 sources
Scores at a glance
2 benchmarks · large dot: Mistral Large 2 (2407); small dots: closest models where reported
ScienceAgentBench ↗10.1%
Mistral-Large-2 (2407) · ScienceAgentBench · Task success · Without expert knowledge ↗
5 more reported results
7.5% · Mistral-Large-2 (2407) · ScienceAgentBench · Task success · Without expert knowledge · ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ↗
16% · Mistral-Large-2 (2407) · ScienceAgentBench · Task success · Without expert knowledge · ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ↗
11.4% · Mistral-Large-2 (2407) · ScienceAgentBench · Task success · With expert knowledge · ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ↗
9.2% · Mistral-Large-2 (2407) · ScienceAgentBench · Task success · With expert knowledge · ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ↗
18.3% · Mistral-Large-2 (2407) · ScienceAgentBench · Task success · With expert knowledge · ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ↗
Closest models by score
Similar positions on shared benchmark leaderboards. Smaller gaps are closer.
There are not enough shared scored settings to identify close comparisons reliably.
Sources
Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.
- Aider refactoring benchmark ↗
- ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery — published result table ↗
All 20 authors
Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N. Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, Huan Sun
Names used in source tables
Mistral Large 2 (2407) · Mistral-Large-2 (2407)