RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

IDEFICS2

2 benchmarks · 2 observations · 2 sources

Scores at a glance

2 benchmarks · large dot: IDEFICS2; small dots: closest models where reported

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Needle In A Multimodal Haystack — published result table ↗

    Weiyun Wang, Shuibo Zhang, Yiming Ren, Yuchen Duan, Tiantong Li, Shuo Liu et al. · 2024

    All 16 authors

    Weiyun Wang, Shuibo Zhang, Yiming Ren, Yuchen Duan, Tiantong Li, Shuo Liu, Mengkang Hu, Zhe Chen, Kaipeng Zhang, Lewei Lu, Xizhou Zhu, Ping Luo, Yu Qiao, Jifeng Dai, Wenqi Shao, Wenhai Wang

  2. LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding — published result table ↗

    Haoning Wu, Dongxu Li, Bei Chen, Junnan Li · 2024

Names used in source tables

IDEFICS2 · Idefics2