RLTasksby ulam.ai
Models / Meta

Meta / MODEL EVIDENCE

Muse Spark Open

44 benchmarks · 109 observations · 49 sources · released 2026-10-15

Scores at a glance

44 benchmarks · large dot: Muse Spark Open; small dots: closest models where reported

GDP.pdf ↗18.60%
7.432.6

Muse Spark Open (Xhigh) · GDP.pdf · all-pass ↗

AA-Omniscience v1.1 ↗25.80 index
-8.2748.13

Muse Spark Open (Xhigh) · AA-Omniscience v1.1 · error-penalized index ↗

1 more reported result

24.65 index · Muse Spark Open (Xhigh) · AA-Omniscience · error-penalized score · Artificial Analysis ↗

SciCode ↗58.45%
42.9466.9

Muse Spark Open (Xhigh) · SciCode · AA implementation ↗

1 more reported result

58.45% · Muse Spark Open (xhigh) · SciCode · Score · % · Epoch AI · SciCode ↗

GPQA Diamond ↗88.99%
87.1796.06

Muse Spark Open (Xhigh) · GPQA Diamond · AA implementation ↗

1 more reported result

88.57% · Muse Spark Open (xhigh) · GPQA diamond · Best score (across scorers) · % · Epoch AI · GPQA diamond ↗

MMMU-Pro ↗80.92%
73.4787.69

Muse Spark Open (Xhigh) · MMMU-Pro · AA implementation ↗

MLCR-AA ↗7.78%
6.1141.67

Muse Spark Open (Xhigh) · MLCR-AA · overall ↗

CritPt ↗14.86%
4.5732.86

Muse Spark Open (Xhigh) · CritPt · original ↗

1 more reported result

14.86% · Muse Spark Open (xhigh) · CritPt · Accuracy · % · Epoch AI · CritPt ↗

GDPx v1.0 ↗1.7%
1.6712.03

Muse Spark Open · GDPx v1.0 · Overall · intended grading ↗

53 more reported results

0.6% · Muse Spark Open · GDPx v1.0 · Eight-domain subset · intended grading · GDPx v1.0 — SemiAnalysis ↗

1.8% · Muse Spark Open · GDPx v1.0 · Recursive Self-Improvement · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Cybersecurity · intended grading · GDPx v1.0 — SemiAnalysis ↗

12.8% · Muse Spark Open · GDPx v1.0 · Biology · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Finance · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Legal · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.9% · Muse Spark Open · GDPx v1.0 · Quant Trading · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.2% · Muse Spark Open · GDPx v1.0 · Hardware Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

2.0% · Muse Spark Open · GDPx v1.0 · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.7% · Muse Spark Open · GDPx v1.0 · Alignment · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Software Engineering · intended grading · GDPx v1.0 — SemiAnalysis ↗

3.9% · Muse Spark Open · GDPx v1.0 · Overall · partial credit · GDPx v1.0 — SemiAnalysis ↗

2.8% · Muse Spark Open · GDPx v1.0 · Eight-domain subset · partial credit · GDPx v1.0 — SemiAnalysis ↗

1.8% · Muse Spark Open · GDPx v1.0 · Recursive Self-Improvement · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Cybersecurity · partial credit · GDPx v1.0 — SemiAnalysis ↗

19.7% · Muse Spark Open · GDPx v1.0 · Biology · partial credit · GDPx v1.0 — SemiAnalysis ↗

3.5% · Muse Spark Open · GDPx v1.0 · Finance · partial credit · GDPx v1.0 — SemiAnalysis ↗

13.8% · Muse Spark Open · GDPx v1.0 · Legal · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.9% · Muse Spark Open · GDPx v1.0 · Quant Trading · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.2% · Muse Spark Open · GDPx v1.0 · Hardware Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

2.4% · Muse Spark Open · GDPx v1.0 · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.7% · Muse Spark Open · GDPx v1.0 · Alignment · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Software Engineering · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Aria · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Arcverex · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Ergodex · Chip Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Arithmetic · Cybersecurity · intended grading · GDPx v1.0 — SemiAnalysis ↗

12.8% · Muse Spark Open · GDPx v1.0 · LatchBio · Biology · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Living Context · Finance · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Chakra · Legal · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.9% · Muse Spark Open · GDPx v1.0 · Third Moment · Quant Trading · intended grading · GDPx v1.0 — SemiAnalysis ↗

1.8% · Muse Spark Open · GDPx v1.0 · Extrapolate · Recursive Self-Improvement · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.2% · Muse Spark Open · GDPx v1.0 · Beautiful Machines · Hardware Design · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · ValenceForge · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

4.0% · Muse Spark Open · GDPx v1.0 · Emulated · Materials Science · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.7% · Muse Spark Open · GDPx v1.0 · Fleet · Alignment · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Datacurve · Software Engineering · intended grading · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Aria · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Arcverex · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Ergodex · Chip Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Arithmetic · Cybersecurity · partial credit · GDPx v1.0 — SemiAnalysis ↗

19.7% · Muse Spark Open · GDPx v1.0 · LatchBio · Biology · partial credit · GDPx v1.0 — SemiAnalysis ↗

3.5% · Muse Spark Open · GDPx v1.0 · Living Context · Finance · partial credit · GDPx v1.0 — SemiAnalysis ↗

13.8% · Muse Spark Open · GDPx v1.0 · Chakra · Legal · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.9% · Muse Spark Open · GDPx v1.0 · Third Moment · Quant Trading · partial credit · GDPx v1.0 — SemiAnalysis ↗

1.8% · Muse Spark Open · GDPx v1.0 · Extrapolate · Recursive Self-Improvement · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.2% · Muse Spark Open · GDPx v1.0 · Beautiful Machines · Hardware Design · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · ValenceForge · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

4.8% · Muse Spark Open · GDPx v1.0 · Emulated · Materials Science · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.7% · Muse Spark Open · GDPx v1.0 · Fleet · Alignment · partial credit · GDPx v1.0 — SemiAnalysis ↗

0.0% · Muse Spark Open · GDPx v1.0 · Datacurve · Software Engineering · partial credit · GDPx v1.0 — SemiAnalysis ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

21.5 percentile-point gap

27 of 42 shared benchmark comparisons

How similarity is measured

Mean absolute gap in percentile positions on shared benchmark settings; lower is closer. At least 60% overlap is required, with a minimum of three when available. Independent evaluations are used when there are at least three; otherwise published report comparisons are used. Repeated model observations within one setting are averaged before ranking. Writing-style traits and composite indices are excluded. This describes similarity, not an overall quality ranking.

Filter comparisons to this model →

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. AA-Briefcase v1.1: Agentic Knowledge Work Benchmark | Artificial Analysis ↗

    Artificial Analysis

  2. Artificial Analysis Intelligence Index v5.0 — Artificial Analysis ↗

    Artificial Analysis

  3. AA-LCR v1.1: Long Context Reasoning Benchmark | Artificial Analysis ↗

    Artificial Analysis

  4. AutomationBench-AA: Agentic SaaS Workflow Benchmark | Artificial Analysis ↗

    Artificial Analysis

  5. CritPt Benchmark | Artificial Analysis ↗

    Artificial Analysis

  6. CritPt v2 — Hard Subset — Artificial Analysis ↗

    Artificial Analysis

  7. FrontierCode 1.1 Benchmark | Artificial Analysis ↗

    Artificial Analysis

  8. FrontierCode 2.0 Benchmark — Artificial Analysis ↗

    Artificial Analysis

  9. GDP.pdf Benchmark | Artificial Analysis ↗

    Artificial Analysis

  10. GDPval-AA v2.1 Benchmark | Artificial Analysis ↗

    Artificial Analysis

  11. GPQA Diamond Benchmark | Artificial Analysis ↗

    Artificial Analysis

  12. HLE-Diamond Benchmark — Artificial Analysis ↗

    Artificial Analysis

  13. Humanity's Last Exam Benchmark | Artificial Analysis ↗

    Artificial Analysis

  14. MLCR-AA: Medical Long Context Reasoning Benchmark | Artificial Analysis ↗

    Artificial Analysis

  15. MMMU-Pro Benchmark | Artificial Analysis ↗

    Artificial Analysis

  16. AA-Omniscience v1.1: Knowledge and Hallucination Benchmark — Artificial Analysis ↗

    Artificial Analysis

  17. SciCode Benchmark | Artificial Analysis ↗

    Artificial Analysis

  18. Terminal-Bench-Science 0.1 Benchmark | Artificial Analysis ↗

    Artificial Analysis

  19. Terminal-Bench 2.1 Benchmark | Artificial Analysis ↗

    Artificial Analysis

  20. Terminal-Bench 4.0 Benchmark | Artificial Analysis ↗

    Artificial Analysis

  21. CritPt v1 ↗

    Epoch AI

  22. FrontierMath Tier 4 (v2) ↗

    Epoch AI

  23. FrontierMath Tiers 1-3 (v2) ↗

    Epoch AI

  24. GPQA Diamond ↗

    Epoch AI

  25. OTIS Mock AIME 2024-2025 ↗

    Epoch AI

  26. SimpleQA Verified ↗

    Epoch AI

  27. AI benchmarks & capabilities ↗

    Epoch AI

  28. GDPx v1.0: The General Agentic Benchmark — SemiAnalysis ↗

    SemiAnalysis · 2026

  29. HiL-Bench (Human-in-Loop Benchmark) — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  30. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  31. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  32. Scale Labs — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  33. SWE-Bench Pro V2 — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  34. SWE-Bench Pro V2 — evaluation methodology and results ↗

    Scale Labs / SEAL · 2026

  35. Code Migration v1 — evaluation methodology and results ↗

    Vals AI · 2026

  36. Code Migration — evaluation methodology and results ↗

    Vals AI · 2026

  37. Excel Modeling Benchmark v1 — evaluation methodology and results ↗

    Vals AI · 2026

  38. Excel Modeling Benchmark — evaluation methodology and results ↗

    Vals AI · 2026

  39. Finance Agent v2 — evaluation methodology and results ↗

    Vals AI · 2026

  40. Finance Agent — evaluation methodology and results ↗

    Vals AI · 2026

  41. Vals Finance Index — evaluation methodology and results ↗

    Vals AI · 2026

  42. HLAB-Vals-1.1 — evaluation methodology and results ↗

    Vals AI · 2026

  43. Harvey's Legal Agent Benchmark v1 — evaluation methodology and results ↗

    Vals AI · 2026

  44. Vals Legal Index — evaluation methodology and results ↗

    Vals AI · 2026

  45. Legal Research Bench — evaluation methodology and results ↗

    Vals AI · 2026

  46. Tax Agent Bench — evaluation methodology and results ↗

    Vals AI · 2026

  47. Terminal-Bench 4.0 — evaluation methodology and results ↗

    Vals AI · 2026

  48. Vals Index — evaluation methodology and results ↗

    Vals AI · 2026

  49. Vibe Code Bench — evaluation methodology and results ↗

    Vals AI · 2026

Names used in source tables

Muse Spark Open · Muse Spark Open (Mini-SWE-agent) · Muse Spark Open (OpenHands) · Muse Spark Open (Xhigh) · Muse Spark Open (mini-swe-agent) xhigh · Muse Spark Open (xhigh) · muse-spark-open