GPT-4V-1106

1 benchmarks · 6 observations · 1 sources

Scores at a glance

1 benchmarks · large dot: GPT-4V-1106; small dots: closest models where reported

GPT-4V-1106 · WindowsAgentArena · Task success · Navi configurations ↗

4 more reported results

13.1% · GPT-4V-1106 · WindowsAgentArena · Task success · Navi configurations · Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ↗

11.3% · GPT-4V-1106 · WindowsAgentArena · Task success · Navi configurations · Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ↗

12.5% · GPT-4V-1106 · WindowsAgentArena · Task success · Navi configurations · Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ↗

19.5% · GPT-4V-1106 · WindowsAgentArena · Task success · Navi configurations · Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale — published result table ↗
Bonatti, Rogerio, Zhao, Dan, Bonacci, Francesco, Dupont, Dillon, Abdali, Sara, Li, Yinheng et al. · 2024
All 12 authors
Bonatti, Rogerio, Zhao, Dan, Bonacci, Francesco, Dupont, Dillon, Abdali, Sara, Li, Yinheng, Lu, Yadong, Wagle, Justin, Koishida, Kazuhito, Bucker, Arthur, Jang, Lawrence, Hui, Zack

Names used in source tables

GPT-4V-1106