RLTasksby ulam.ai
Models / Meta

Meta / MODEL EVIDENCE

Llama 2-13b / chat

5 benchmarks · 15 observations · 5 sources

Scores at a glance

5 benchmarks · large dot: Llama 2-13b / chat; small dots: closest models where reported

AgentBench & ToolBench ↗0.77 points
0.034.01

llama-2-13b / chat · AgentBench & ToolBench · AgentBench overall · Original standard test set ↗

HarmBench ↗2.8%
0.865.8

Llama-2-13b-chat · HarmBench · HarmBench harmful compliance · SORRY-Bench paper · cross-benchmark comparison ↗

WikiContradict ↗11.5%
1.250.6

Llama-2-13b-chat · WikiContradict · All instances · Fully correct · Llama-3-70B judge · template 5 ↗

8 more reported results

73.5% · Llama-2-13b-chat · WikiContradict · All instances · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

9.5% · Llama-2-13b-chat · WikiContradict · All instances · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

12.4% · Llama-2-13b-chat · WikiContradict · Explicit contradictions · Fully correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

74.5% · Llama-2-13b-chat · WikiContradict · Explicit contradictions · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

7.5% · Llama-2-13b-chat · WikiContradict · Explicit contradictions · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

9.8% · Llama-2-13b-chat · WikiContradict · Implicit contradictions · Fully correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

71.7% · Llama-2-13b-chat · WikiContradict · Implicit contradictions · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

13% · Llama-2-13b-chat · WikiContradict · Implicit contradictions · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. L-Eval: Instituting Standardized Evaluation for Long Context Language Models — published result table ↗

    Chenxin An, Shansan Gong, Ming Zhong, Xingjian Zhao, Mukai Li, Jun Zhang et al. · 2023

    All 8 authors

    Chenxin An, Shansan Gong, Ming Zhong, Xingjian Zhao, Mukai Li, Jun Zhang, Lingpeng Kong, Xipeng Qiu

  2. AgentBench: Evaluating LLMs as Agents — published result table ↗

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai et al. · 2023

    All 22 authors

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang

  3. CriticBench: Benchmarking LLMs for Critique-Correct Reasoning — published result table ↗

    Zicheng Lin, Zhibin Gou, Tian Liang, Ruilin Luo, Haowei Liu, Yujiu Yang · 2024

  4. WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia — published result table ↗

    Hou, Yufang, Pascale, Alessandra, Carnerero-Cano, Javier, Tchrakian, Tigran, Marinescu, Radu, Daly, Elizabeth et al. · 2024

    All 8 authors

    Hou, Yufang, Pascale, Alessandra, Carnerero-Cano, Javier, Tchrakian, Tigran, Marinescu, Radu, Daly, Elizabeth, Padhi, Inkit, Sattigeri, Prasanna

  5. SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal — published result table ↗

    Tinghao Xie, Xiangyu Qi, Yi Zeng, Yangsibo Huang, Udari Madhushani Sehwag, Kaixuan Huang et al. · 2024

    All 16 authors

    Tinghao Xie, Xiangyu Qi, Yi Zeng, Yangsibo Huang, Udari Madhushani Sehwag, Kaixuan Huang, Luxi He, Boyi Wei, Dacheng Li, Ying Sheng, Ruoxi Jia, Bo Li, Kai Li, Danqi Chen, Peter Henderson, Prateek Mittal

Names used in source tables

LLaMa-2-13b chat · Llama-2-13b-chat · Llama2-13b-chat · llama-2-13b / chat