Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

$\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains — published result table ↗
Yao, Shunyu, Shinn, Noah, Razavi, Pedram, Narasimhan, Karthik · 2024
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions — published result table ↗
Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari et al. · 2024
All 33 authors
Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, Binyuan Hui, Niklas Muennighoff, David Lo, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra
WildHallucinations: Evaluating Long-form Factuality in LLMs with Real-World Entity Queries — published result table ↗
Wenting Zhao, Tanya Goyal, Yu Ying Chiu, Liwei Jiang, Benjamin Newman, Abhilasha Ravichander et al. · 2024
All 11 authors
Wenting Zhao, Tanya Goyal, Yu Ying Chiu, Liwei Jiang, Benjamin Newman, Abhilasha Ravichander, Khyathi Chandu, Ronan Le Bras, Claire Cardie, Yuntian Deng, Yejin Choi
DTBench — Conceptual Reasoning Index ↗
Conceptual Reasoning Index
Holistic Evaluation of Language Models (HELM) ↗
Stanford Center for Research on Foundation Models
Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Models ↗
Zhang, Andy K., Perry, Neil, Dulepet, Riya, Ji, Joey, Menders, Celeste, Lin, Justin W. et al. · 2024
All 27 authors
Zhang, Andy K., Perry, Neil, Dulepet, Riya, Ji, Joey, Menders, Celeste, Lin, Justin W., Jones, Eliot, Hussein, Gashon, Liu, Samantha, Jasper, Donovan, Peetathawatchai, Pura, Glenn, Ari, Sivashankar, Vikram, Zamoshchin, Daniel, Glikbarg, Leo, Askaryar, Derek, Yang, Mike, Zhang, Teddy, Alluri, Rishi, Tran, Nathan, Sangpisit, Rinnara, Yiorkadjis, Polycarpos, Osele, Kenny, Raghupathi, Gautham, Boneh, Dan, Ho, Daniel E., Liang, Percy
GPQA Diamond ↗
Epoch AI
MATH Level 5 ↗
Epoch AI
AI benchmarks & capabilities ↗
Epoch AI
WeirdML ↗
Håvard Tveit Ihle
Scale Labs — evaluation methodology and results ↗
Scale Labs / SEAL · 2026
AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models — published result table ↗
Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang et al. · 2023
All 9 authors
Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen, Nan Duan

Names used in source tables

Mixtral / 8x22B · Mixtral 8x22B · Mixtral-8x22B · mixtral-8x22b