Muse Wonder Full low vs Opus 4.8 medium
Muse Wonder Full low leads on speed and cost; quality is too close to call.
- Quality
- +3.2 pts
- Muse Wonder Full low
- 5–3 head to head, 15 tied
- Speed
- 1.1× faster
- Muse Wonder Full low
- 21.6 min vs 23.3 min per task
- Cost
- 2.2× cheaper
- Muse Wonder Full low
- $2.85 vs $6.27 per task
Stet score
Muse Wonder Full lowlow reasoningRank 7 of 17
52.095% range 48.4–56.03.2 points higher
Opus 4.8 mediummedium reasoningRank 11 of 17
48.895% range 39.7–58.0
Quality
Head-to-head matchups
Muse Wonder Full low won5
Tied15
Opus 4.8 medium won3
Task by task
Muse Wonder Full low solved 3 tasks that Opus 4.8 medium didn’t, and Opus 4.8 medium solved 2 that Muse Wonder Full low didn’t. Both solved 11; neither solved 8.
stet-15439c21Solved by 9 of 17 setups
- Muse Wonder Full lowEquivalent to the merged fix
- Opus 4.8 mediumFailed
A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently.
All 24 compared tasks
| Task | Muse Wonder Full low | Opus 4.8 medium | Solved by |
|---|---|---|---|
stet-3169aefa | Passed tests | Passed tests | Both |
stet-89dfbc27 | Passed tests | Passed tests | Both |
stet-b28f4fe7 | Passed tests | Passed tests | Both |
stet-232b50ba | Passed tests | Passed tests | Both |
stet-5276aa3f | Passed tests | Passed tests | Both |
stet-commit-bbbbae09 | Passed tests | Passed tests | Both |
stet-66762b4c | Passed tests | Passed tests | Both |
stet-commit-5d766dde | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-43493c52 | Passed tests | Passed tests | Both |
stet-commit-f0caded9 | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-commit-f8ae1177 | Passed tests | Passed tests | Both |
stet-15439c21 | Equivalent to the merged fix | Failed | Muse Wonder Full low only |
stet-2450ca2d | Passed tests | Failed | Muse Wonder Full low only |
stet-commit-342d0ac0 | Failed | Failed | Neither |
stet-6f84e978 | Failed | Passed tests | Opus 4.8 medium only |
stet-commit-60a0e6c2 | Failed | Passed tests | Opus 4.8 medium only |
stet-commit-5e075641 | Failed | Failed | Neither |
stet-commit-2826765e | Failed | Failed | Neither |
stet-commit-a8716b88 | Failed | Failed | Neither |
stet-commit-e928166f | Equivalent to the merged fix | Failed | Muse Wonder Full low only |
stet-commit-30506f8e | Failed | Failed | Neither |
stet-commit-87814583 | Failed | Failed | Neither |
stet-commit-d2ab0c25 | Failed | Failed | Neither |
stet-commit-e41c2e2d | Failed | Failed | Neither |
Side by side
| Metric | Muse Wonder Full low | Opus 4.8 medium |
|---|---|---|
| Reasoning effort | low | medium |
| Rank | 7 of 17 | 11 of 17 |
| Stet score | 52.095% range 48.4–56.0 | 48.895% range 39.7–58.0 |
| Solved | 14/2410 passed, 4 judged equivalent | 13/2411 passed, 2 judged equivalent |
| Cost / task | $2.85 | $6.27 |
| Agent time / task | 21.6 min | 23.3 min |
See which setup wins on your repo
Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.
Get startedAbout this data
- 24 tasks, each a merged change replayed from the repo as it was just before the merge.
- Data from .
- Both setups come from the same leaderboard run of 17 setups:
bmk_d4ba310fdf50db4ccb2092e3.