Anthropic / MODEL EVIDENCE

Claude Instant

6 benchmarks · 13 observations · 5 sources · released 2023-08-09

Scores at a glance

6 benchmarks · large dot: Claude Instant; small dots: closest models where reported

41.6598.93

Claude Instant · DTBench · Accuracy · % ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. DTBench — Conceptual Reasoning Index ↗

    Conceptual Reasoning Index

  2. Holistic Evaluation of Language Models (HELM) ↗

    Stanford Center for Research on Foundation Models

  3. AI benchmarks & capabilities ↗

    Epoch AI

  4. Model Card and Evaluations for Claude Models ↗

    Anthropic · 2023

  5. Releasing Claude Instant 1.2 ↗

    Anthropic

Names used in source tables

Claude Instant