RLTasksby ulam.ai
Models / Reported model

Reported model / MODEL EVIDENCE

FLAN-PaLM (540B)

2 benchmarks · 5 observations · 2 sources

Scores at a glance

2 benchmarks · large dot: FLAN-PaLM (540B); small dots: closest models where reported

MultiMedQA & HealthSearchQA ↗60.3%
25.760.3

Flan-PaLM 540B · MultiMedQA & HealthSearchQA · MedQA four-option · five-shot · accuracy · PaLM and Flan-PaLM comparison ↗

2 more reported results

56.5% · Flan-PaLM 540B · MultiMedQA & HealthSearchQA · MedMCQA · five-shot · accuracy · PaLM and Flan-PaLM comparison · Large Language Models Encode Clinical Knowledge ↗

79% · Flan-PaLM 540B · MultiMedQA & HealthSearchQA · PubMedQA · three-shot · accuracy · PaLM and Flan-PaLM comparison · Large Language Models Encode Clinical Knowledge ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Large Language Models Encode Clinical Knowledge — published result table ↗

    Singhal, Karan, Azizi, Shekoofeh, Tu, Tao, Mahdavi, S. Sara, Wei, Jason, Chung, Hyung Won et al. · 2022

    All 30 authors

    Singhal, Karan, Azizi, Shekoofeh, Tu, Tao, Mahdavi, S. Sara, Wei, Jason, Chung, Hyung Won, Scales, Nathan, Tanwani, Ajay, Cole-Lewis, Heather, Pfohl, Stephen, Payne, Perry, Seneviratne, Martin, Gamble, Paul, Kelly, Chris, Scharli, Nathaneal, Chowdhery, Aakanksha, Mansfield, Philip, Arcas, Blaise Aguera y, Webster, Dale, Corrado, Greg S., Matias, Yossi, Chou, Katherine, Gottweis, Juraj, Tomasev, Nenad, Liu, Yun, Rajkomar, Alvin, Barral, Joelle, Semturs, Christopher, Karthikesalingam, Alan, Natarajan, Vivek

  2. FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation — published result table ↗

    Vu, Tu, Iyyer, Mohit, Wang, Xuezhi, Constant, Noah, Wei, Jerry, Wei, Jason et al. · 2023

    All 11 authors

    Vu, Tu, Iyyer, Mohit, Wang, Xuezhi, Constant, Noah, Wei, Jerry, Wei, Jason, Tar, Chris, Sung, Yun-Hsuan, Zhou, Denny, Le, Quoc, Luong, Thang

Names used in source tables

FLAN-PaLM (540B) · Flan-PaLM 540B