RLTasksby ulam.ai
Models / Anthropic

Anthropic / MODEL EVIDENCE

Claude 1.3

3 benchmarks · 4 observations · 2 sources · released 2023-04-18

Scores at a glance

3 benchmarks · large dot: Claude 1.3; small dots: closest models where reported

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

Claude 2 →Anthropic
50.0 percentile-point gap

2 of 2 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Towards Understanding Sycophancy in Language Models — published result table ↗

    Sharma, Mrinank, Tong, Meg, Korbak, Tomasz, Duvenaud, David, Askell, Amanda, Bowman, Samuel R. et al. · 2023

    All 19 authors

    Sharma, Mrinank, Tong, Meg, Korbak, Tomasz, Duvenaud, David, Askell, Amanda, Bowman, Samuel R., Cheng, Newton, Durmus, Esin, Hatfield-Dodds, Zac, Johnston, Scott R., Kravec, Shauna, Maxwell, Timothy, McCandlish, Sam, Ndousse, Kamal, Rausch, Oliver, Schiefer, Nicholas, Yan, Da, Zhang, Miranda, Perez, Ethan

  2. Model Card and Evaluations for Claude Models ↗

    Anthropic · 2023

Names used in source tables

Claude 1.3