Skip to the comparison

GPT 6 Luna max vs Muse Spark 1.3 high

Muse Spark 1.3 high leads on speed and cost; quality is too close to call.

Quality
+5.9 pts
Muse Spark 1.3 high
3–0 head to head, 18 tied
Speed
4.5× faster
Muse Spark 1.3 high
13.2 min vs 59.7 min per task
Cost
3.7× cheaper
Muse Spark 1.3 high
$0.10 vs $0.37 per task

24 tasksData from

Stet score

GPT 6 Luna maxmax reasoningRank 14 of 17

46.095% range 40.4–51.6

Muse Spark 1.3 highhigh reasoningRank 8 of 17

51.995% range 47.9–56.05.9 points higher

A directional read: their 95% score ranges overlap.

Quality

Head-to-head matchups

GPT 6 Luna max won0

Tied18

Muse Spark 1.3 high won3

3 undecided
Muse Spark 1.3 high’s win share 56%, 95% range 49–64%Ties are within judge noise.

Task by task

GPT 6 Luna max solved 2 tasks that Muse Spark 1.3 high didn’t, and Muse Spark 1.3 high solved 2 that GPT 6 Luna max didn’t. Both solved 9; neither solved 9.

stet-commit-f0caded9Solved by 12 of 17 setups

  • GPT 6 Luna maxEquivalent to the merged fix
  • Muse Spark 1.3 highFailed

A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently. 2 of the 24 tasks are left out because one of the two has no scored result on them.

All 22 compared tasks
Task by task
TaskGPT 6 Luna maxMuse Spark 1.3 highSolved by
stet-3169aefaPassed testsPassed testsBoth
stet-89dfbc27Passed testsPassed testsBoth
stet-b28f4fe7Passed testsPassed testsBoth
stet-232b50baPassed testsPassed testsBoth
stet-5276aa3fPassed testsPassed testsBoth
stet-commit-bbbbae09Passed testsPassed testsBoth
stet-66762b4cEquivalent to the merged fixPassed testsBoth
stet-commit-5d766ddeEquivalent to the merged fixEquivalent to the merged fixBoth
stet-43493c52Passed testsPassed testsBoth
stet-commit-f0caded9Equivalent to the merged fixFailedGPT 6 Luna max only
stet-commit-f8ae1177FailedPassed testsMuse Spark 1.3 high only
stet-15439c21FailedFailedNeither
stet-2450ca2dFailedEquivalent to the merged fixMuse Spark 1.3 high only
stet-commit-342d0ac0Equivalent to the merged fixFailedGPT 6 Luna max only
stet-6f84e978FailedFailedNeither
stet-commit-60a0e6c2FailedFailedNeither
stet-commit-5e075641FailedFailedNeither
stet-commit-2826765eFailedFailedNeither
stet-commit-a8716b88FailedFailedNeither
stet-commit-e928166fFailedFailedNeither
stet-commit-30506f8eFailedFailedNeither
stet-commit-d2ab0c25FailedFailedNeither

Side by side

Side by side
MetricGPT 6 Luna maxMuse Spark 1.3 high
Reasoning effortmaxhigh
Rank14 of 178 of 17
Stet score46.095% range 40.4–51.651.995% range 47.9–56.0
Solved11/247 passed, 4 judged equivalent11/249 passed, 2 judged equivalent
Cost / task$0.37$0.10
Agent time / task59.7 min13.2 min

See which setup wins on your repo

Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.

Get started