RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

BLOOMZ (7B)

3 benchmarks · 7 observations · 3 sources

Scores at a glance

3 benchmarks · large dot: BLOOMZ (7B); small dots: closest models where reported

CMMLU ↗37.04%
31.2470.95

BLOOMZ-7B · CMMLU · Five-shot subject-macro accuracy · original five-shot comparison ↗

BhasaBench / IndicGenBench ↗1.2 points
041.1

BLOOMZ-7B · BhasaBench / IndicGenBench · CrossSum-In · one-shot evaluation ↗

4 more reported results

40.8 points · BLOOMZ-7B · BhasaBench / IndicGenBench · Flores-In · one-shot evaluation · IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages ↗

53.7 points · BLOOMZ-7B · BhasaBench / IndicGenBench · XQuAD-In · one-shot evaluation · IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages ↗

7 points · BLOOMZ-7B · BhasaBench / IndicGenBench · XorQA-In-Xx · one-shot evaluation · IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages ↗

49 points · BLOOMZ-7B · BhasaBench / IndicGenBench · XorQA-In-En · one-shot evaluation · IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. CMMLU: Measuring massive multitask language understanding in Chinese — published result table ↗

    Li, Haonan, Zhang, Yixuan, Koto, Fajri, Yang, Yifei, Zhao, Hai, Gong, Yeyun et al. · 2023

    All 8 authors

    Li, Haonan, Zhang, Yixuan, Koto, Fajri, Yang, Yifei, Zhao, Hai, Gong, Yeyun, Duan, Nan, Baldwin, Timothy

  2. ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic — published result table ↗

    Koto, Fajri, Li, Haonan, Shatnawi, Sara, Doughman, Jad, Sadallah, Abdelrahman Boda, Alraeesi, Aisha et al. · 2024

    All 13 authors

    Koto, Fajri, Li, Haonan, Shatnawi, Sara, Doughman, Jad, Sadallah, Abdelrahman Boda, Alraeesi, Aisha, Almubarak, Khalid, Alyafeai, Zaid, Sengupta, Neha, Shehata, Shady, Habash, Nizar, Nakov, Preslav, Baldwin, Timothy

  3. IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages — published result table ↗

    Harman Singh, Nitish Gupta, Shikhar Bharadwaj, Dinesh Tewari, Partha Talukdar · 2024

Names used in source tables

BLOOMZ (7B) · BLOOMZ-7B