Skip to the comparison
STET
Join the waitlist

Muse Wonder Full low vs Opus 5 medium

No clear quality winner: Muse Wonder Full low won 11, Opus 5 medium won 5, 4 tied, 4 undecided; Muse Wonder Full low leads on cost and agent time: 2.4× cheaper and 1.1× faster.

24 tasksData from

Stet score

Muse Wonder Full lowmuse · low reasoningRank 1 of 16

70.495% range 58.6–81.28.1 points higher

Opus 5 mediummedium reasoningRank 5 of 16

62.395% range 52.0–72.0

A directional read: their 95% score ranges overlap.

Cost / task

Muse Wonder Full low$2.852.4× cheaper
Opus 5 medium$6.78

Agent time / task

Muse Wonder Full low21.6 min1.1× faster
Opus 5 medium23.2 min

Quality

Head-to-head matchups

Muse Wonder Full low won11

Tied44 undecided

Opus 5 medium won5

Muse Wonder Full low’s win share 65%, 95% range 46–84%Ties are within judge noise.

Task by task

Muse Wonder Full low solved 1 task that Opus 5 medium didn’t, and Opus 5 medium solved 1 that Muse Wonder Full low didn’t. Both solved 11; neither solved 7.

Muse Wonder Full low only 1

  • stet-commit-e928166fEquivalent to the merged fix

Opus 5 medium only 1

  • stet-6f84e978Passed tests

A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently. 4 of the 24 tasks are left out because one of the two has no scored result on them.

All 20 compared tasks
Task by task
TaskMuse Wonder Full lowOpus 5 mediumSolved by
stet-3169aefaPassed testsPassed testsBoth
stet-89dfbc27Passed testsPassed testsBoth
stet-b28f4fe7Passed testsPassed testsBoth
stet-232b50baPassed testsPassed testsBoth
stet-5276aa3fPassed testsPassed testsBoth
stet-commit-bbbbae09Passed testsPassed testsBoth
stet-66762b4cEquivalent to the merged fixPassed testsBoth
stet-15439c21Passed testsPassed testsBoth
stet-commit-5d766ddeEquivalent to the merged fixEquivalent to the merged fixBoth
stet-43493c52Passed testsPassed testsBoth
stet-6f84e978FailedPassed testsOpus 5 medium only
stet-2450ca2dPassed testsPassed testsBoth
stet-commit-342d0ac0FailedFailedNeither
stet-commit-60a0e6c2FailedFailedNeither
stet-commit-5e075641FailedFailedNeither
stet-commit-a8716b88FailedFailedNeither
stet-commit-e928166fEquivalent to the merged fixFailedMuse Wonder Full low only
stet-commit-30506f8eFailedFailedNeither
stet-commit-d2ab0c25FailedFailedNeither
stet-commit-e41c2e2dFailedFailedNeither

Side by side

Side by side
MetricMuse Wonder Full lowOpus 5 medium
Harnessmuse—
Reasoning effortlowmedium
Rank1 of 165 of 16
Stet score70.495% range 58.6–81.262.395% range 52.0–72.0
Solved12/249 passed, 3 judged equivalent14/2412 passed, 2 judged equivalent
Cost / task$2.85$6.78
Agent time / task21.6 min23.2 min

See which setup wins on your repo

Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.

Run it on your repo

About this data

  • 24 tasks, each a merged change replayed from the repo as it was just before the merge.
  • Data from .
  • Both setups come from the same leaderboard run of 16 setups: bmk_d4ba310fdf50db4ccb2092e3.

See all 16 setups on the leaderboardHow Stet measures