RLTasksby ulam.ai
Models / Mistral

Mistral / MODEL EVIDENCE

Mistral-Nemo-Instruct-2407

3 benchmarks · 11 observations · 3 sources

Scores at a glance

3 benchmarks · large dot: Mistral-Nemo-Instruct-2407; small dots: closest models where reported

HalluLens ↗24.24%
8.7352.59

Mistral-Nemo-Instruct-2407 · HalluLens · PreciseWikiQA correct answers · three-trial mean ↗

1 more reported result

90.87% · Mistral-Nemo-Instruct-2407 · HalluLens · MixedEntities false acceptance · fabricated-entity acceptance · HalluLens: LLM Hallucination Benchmark ↗

LongMemEval ↗16.2%
0.831.2

Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval S · full history direct · QA accuracy · additional-model comparison ↗

5 more reported results

28.6% · Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval S · full history CoN · QA accuracy · additional-model comparison · LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ↗

64% · Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval S · key=value · QA accuracy · additional-model comparison · LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ↗

66.6% · Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval S · fact-expanded keys · QA accuracy · additional-model comparison · LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ↗

55.4% · Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval M · key=value · QA accuracy · additional-model comparison · LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ↗

59.8% · Mistral-Nemo-Instruct-2407 · LongMemEval · LongMemEval M · fact-expanded keys · QA accuracy · additional-model comparison · LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ↗

UGPhysics ↗16%
5.3657.16

Mistral-Nemo-Instruct-2407 · UGPhysics · English · overall accuracy · original evaluation ↗

2 more reported results

13.62% · Mistral-Nemo-Instruct-2407 · UGPhysics · Chinese · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗

14.81% · Mistral-Nemo-Instruct-2407 · UGPhysics · Language average · overall accuracy · original evaluation · UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory — published result table ↗

    Wu, Di, Wang, Hongwei, Yu, Wenhao, Zhang, Yuwei, Chang, Kai-Wei, Yu, Dong · 2024

  2. UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models — published result table ↗

    Xin Xu, Qiyun Xu, Tong Xiao, Tianhao Chen, Yuchen Yan, Jiaxin Zhang et al. · 2025

    All 9 authors

    Xin Xu, Qiyun Xu, Tong Xiao, Tianhao Chen, Yuchen Yan, Jiaxin Zhang, Shizhe Diao, Can Yang, Yang Wang

  3. HalluLens: LLM Hallucination Benchmark — published result table ↗

    Yejin Bang, Ziwei Ji, Alan Schelten, Anthony Hartshorn, Tara Fowler, Cheng Zhang et al. · 2025

    All 8 authors

    Yejin Bang, Ziwei Ji, Alan Schelten, Anthony Hartshorn, Tara Fowler, Cheng Zhang, Nicola Cancedda, Pascale Fung

Names used in source tables

Mistral-Nemo-Instruct-2407