RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

vicuna-33b / v1.3

3 benchmarks · 6 observations · 3 sources

Scores at a glance

3 benchmarks · large dot: vicuna-33b / v1.3; small dots: closest models where reported

MuSR (Multistep Soft Reasoning) ↗49.6%
48.480.4

Vicuna 33b v1.3 · MuSR (Multistep Soft Reasoning) · Accuracy · Murder mysteries · CoT+ ↗

2 more reported results

31.2% · Vicuna 33b v1.3 · MuSR (Multistep Soft Reasoning) · Accuracy · Object placement · CoT+ · MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning ↗

30% · Vicuna 33b v1.3 · MuSR (Multistep Soft Reasoning) · Accuracy · Team allocation · CoT+ · MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. AgentBench: Evaluating LLMs as Agents — published result table ↗

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai et al. · 2023

    All 22 authors

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Aohan Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, Jie Tang

  2. MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning — published result table ↗

    Zayne Sprague, Xi Ye, Kaj Bostrom, Swarat Chaudhuri, Greg Durrett · 2023

  3. MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures — published result table ↗

    Jinjie Ni, Fuzhao Xue, Xiang Yue, Yuntian Deng, Mahir Shah, Kabir Jain et al. · 2024

    All 8 authors

    Jinjie Ni, Fuzhao Xue, Xiang Yue, Yuntian Deng, Mahir Shah, Kabir Jain, Graham Neubig, Yang You

Names used in source tables

Vicuna 33b v1.3 · Vicuna-33B-v1.3 · vicuna-33b / v1.3