GPT 5.6 Luna low vs Muse Wonder Full low
Muse Wonder Full low leads on quality; GPT 5.6 Luna low on speed and cost.
- Quality
- +7.1 pts
- Muse Wonder Full low
- 4–0 head to head, 20 tied
- Not yet conclusive across all 136 comparisons on the board.
- Speed
- 3.2× faster
- GPT 5.6 Luna low
- 6.7 min vs 21.6 min per task
- Cost
- 55.9× cheaper
- GPT 5.6 Luna low
- $0.05 vs $2.85 per task
Stet score
GPT 5.6 Luna lowcodex · low reasoningRank 15 of 17
45.095% range 39.1–50.4
Muse Wonder Full lowlow reasoningRank 7 of 17
52.195% range 48.7–55.97.1 points higher
Quality
Head-to-head matchups
GPT 5.6 Luna low won0
Tied20
Muse Wonder Full low won4
Task by task
GPT 5.6 Luna low solved 0 tasks that Muse Wonder Full low didn’t, and Muse Wonder Full low solved 4 that GPT 5.6 Luna low didn’t. Both solved 10; neither solved 10.
stet-commit-bbbbae09Solved by 15 of 17 setups
- GPT 5.6 Luna lowFailed
- Muse Wonder Full lowPassed tests
A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently.
All 24 compared tasks
| Task | GPT 5.6 Luna low | Muse Wonder Full low | Solved by |
|---|---|---|---|
stet-232b50ba | Passed tests | Passed tests | Both |
stet-3169aefa | Passed tests | Passed tests | Both |
stet-5276aa3f | Passed tests | Passed tests | Both |
stet-89dfbc27 | Passed tests | Passed tests | Both |
stet-b28f4fe7 | Passed tests | Passed tests | Both |
stet-commit-bbbbae09 | Failed | Passed tests | Muse Wonder Full low only |
stet-66762b4c | Equivalent to the merged fix | Passed tests | Both |
stet-commit-5d766dde | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-commit-f0caded9 | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-43493c52 | Passed tests | Passed tests | Both |
stet-commit-f8ae1177 | Failed | Passed tests | Muse Wonder Full low only |
stet-15439c21 | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-2450ca2d | Failed | Passed tests | Muse Wonder Full low only |
stet-commit-342d0ac0 | Failed | Failed | Neither |
stet-6f84e978 | Failed | Failed | Neither |
stet-commit-60a0e6c2 | Failed | Failed | Neither |
stet-commit-5e075641 | Failed | Failed | Neither |
stet-commit-2826765e | Failed | Failed | Neither |
stet-commit-a8716b88 | Failed | Failed | Neither |
stet-commit-e928166f | Failed | Equivalent to the merged fix | Muse Wonder Full low only |
stet-commit-30506f8e | Failed | Failed | Neither |
stet-commit-87814583 | Failed | Failed | Neither |
stet-commit-d2ab0c25 | Failed | Failed | Neither |
stet-commit-e41c2e2d | Failed | Failed | Neither |
Side by side
| Metric | GPT 5.6 Luna low | Muse Wonder Full low |
|---|---|---|
| Harness | codex | — |
| Reasoning effort | low | low |
| Rank | 15 of 17 | 7 of 17 |
| Stet score | 45.095% range 39.1–50.4 | 52.195% range 48.7–55.9 |
| Solved | 10/246 passed, 4 judged equivalent | 14/2410 passed, 4 judged equivalent |
| Cost / task | $0.05 | $2.85 |
| Agent time / task | 6.7 min | 21.6 min |
See which setup wins on your repo
Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.
Run it on your repoAbout this data
- 24 tasks, each a merged change replayed from the repo as it was just before the merge.
- Data from .
- Both setups come from the same leaderboard run of 17 setups:
bmk_d4ba310fdf50db4ccb2092e3.