Skip to the comparison
STET
Get a free trial

Haiku 5.5 low+guidance vs Muse Wonder Full low

Muse Wonder Full low leads on quality: won 15, tied 3, lost 2, 4 undecided head to head; Haiku 5.5 low+guidance leads on agent time: 1.7× faster; Muse Wonder Full low’s cost wasn’t recorded.

24 tasksData from

Stet score

Haiku 5.5 low+guidanceclaude-code · low reasoningRank 11 of 16

40.895% range 32.0–49.5

Muse Wonder Full lowmuse · low reasoningRank 1 of 16

72.495% range 60.4–83.331.6 points higher

Their 95% score ranges don’t overlap.

Cost / task

Haiku 5.5 low+guidance$0.29
Muse Wonder Full lownot recorded

Agent time / task

Haiku 5.5 low+guidance12.4 min1.7× faster
Muse Wonder Full low21.6 min

Quality

Head-to-head matchups

Haiku 5.5 low+guidance won2

Tied34 undecided

Muse Wonder Full low won15

Muse Wonder Full low’s win share 84%, 95% range 71–95%Ties are within judge noise.

Task by task

Haiku 5.5 low+guidance solved 0 tasks that Muse Wonder Full low didn’t, and Muse Wonder Full low solved 4 that Haiku 5.5 low+guidance didn’t. Both solved 8; neither solved 8.

Haiku 5.5 low+guidance only 0

Muse Wonder Full low only 4

  • stet-15439c21Passed tests
  • stet-commit-5d766ddeEquivalent to the merged fix
  • stet-2450ca2dPassed tests
  • stet-commit-e928166fEquivalent to the merged fix

A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently. 4 of the 24 tasks are left out because one of the two has no scored result on them.

All 20 compared tasks
Task by task
TaskHaiku 5.5 low+guidanceMuse Wonder Full lowSolved by
stet-3169aefaPassed testsPassed testsBoth
stet-89dfbc27Passed testsPassed testsBoth
stet-b28f4fe7Passed testsPassed testsBoth
stet-232b50baPassed testsPassed testsBoth
stet-5276aa3fPassed testsPassed testsBoth
stet-commit-bbbbae09Passed testsPassed testsBoth
stet-66762b4cPassed testsEquivalent to the merged fixBoth
stet-15439c21FailedPassed testsMuse Wonder Full low only
stet-commit-5d766ddeFailedEquivalent to the merged fixMuse Wonder Full low only
stet-43493c52Passed testsPassed testsBoth
stet-6f84e978FailedFailedNeither
stet-2450ca2dFailedPassed testsMuse Wonder Full low only
stet-commit-342d0ac0FailedFailedNeither
stet-commit-60a0e6c2FailedFailedNeither
stet-commit-5e075641FailedFailedNeither
stet-commit-a8716b88FailedFailedNeither
stet-commit-e928166fFailedEquivalent to the merged fixMuse Wonder Full low only
stet-commit-30506f8eFailedFailedNeither
stet-commit-d2ab0c25FailedFailedNeither
stet-commit-e41c2e2dFailedFailedNeither

Side by side

Side by side
MetricHaiku 5.5 low+guidanceMuse Wonder Full low
Harnessclaude-codemuse
Reasoning effortlowlow
Rank11 of 161 of 16
Stet score40.895% range 32.0–49.572.495% range 60.4–83.3
Solved9/248 passed, 1 judged equivalent12/249 passed, 3 judged equivalent
Cost / task$0.29not recorded
Agent time / task12.4 min21.6 min

See which setup wins on your repo

Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.

Run it on your repo

About this data

  • 24 tasks, each a merged change replayed from the repo as it was just before the merge.
  • Data from .
  • Both setups come from the same leaderboard run of 16 setups: bmk_d4ba310fdf50db4ccb2092e3.

See all 16 setups on the leaderboardHow Stet measures