RLTasksby ulam.ai
Models / Mistral

Mistral / MODEL EVIDENCE

Mixtral-8x7B-Inst

2 benchmarks · 19 observations · 2 sources

Scores at a glance

2 benchmarks · large dot: Mixtral-8x7B-Inst; small dots: closest models where reported

WildBench ↗47.8 points
6.265.3

Mixtral-8x7B-Inst · WildBench · WB-Score · reported comparison ↗

WikiContradict ↗37.9%
1.250.6

Mixtral-8x7b-inst · WikiContradict · All instances · Fully correct · Llama-3-70B judge · template 5 ↗

17 more reported results

52.2% · Mixtral-8x7b-inst · WikiContradict · All instances · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

6.3% · Mixtral-8x7b-inst · WikiContradict · All instances · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

43.5% · Mixtral-8x7b-inst · WikiContradict · Explicit contradictions · Fully correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

48.4% · Mixtral-8x7b-inst · WikiContradict · Explicit contradictions · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

3.7% · Mixtral-8x7b-inst · WikiContradict · Explicit contradictions · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

28.3% · Mixtral-8x7b-inst · WikiContradict · Implicit contradictions · Fully correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

58.7% · Mixtral-8x7b-inst · WikiContradict · Implicit contradictions · Partially correct · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

10.9% · Mixtral-8x7b-inst · WikiContradict · Implicit contradictions · Incorrect · Llama-3-70B judge · template 5 · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

2.1% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 1 · All · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

0% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 1 · Explicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

5.9% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 1 · Implicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

4.2% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 4 · All · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

3.3% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 4 · Explicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

5.9% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 4 · Implicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

14.6% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 5 · All · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

16.7% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 5 · Explicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

11.8% · Mixtral-8x7b-inst · WikiContradict · WikiContradict HumanEval · Template 5 · Implicit · fully correct · human annotation · WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild — published result table ↗

    Lin, Bill Yuchen, Deng, Yuntian, Chandu, Khyathi, Brahman, Faeze, Ravichander, Abhilasha, Pyatkin, Valentina et al. · 2024

    All 9 authors

    Lin, Bill Yuchen, Deng, Yuntian, Chandu, Khyathi, Brahman, Faeze, Ravichander, Abhilasha, Pyatkin, Valentina, Dziri, Nouha, Bras, Ronan Le, Choi, Yejin

  2. WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia — published result table ↗

    Hou, Yufang, Pascale, Alessandra, Carnerero-Cano, Javier, Tchrakian, Tigran, Marinescu, Radu, Daly, Elizabeth et al. · 2024

    All 8 authors

    Hou, Yufang, Pascale, Alessandra, Carnerero-Cano, Javier, Tchrakian, Tigran, Marinescu, Radu, Daly, Elizabeth, Padhi, Inkit, Sattigeri, Prasanna

Names used in source tables

Mixtral-8x7B-Inst · Mixtral-8x7b-inst