Grok 4.7 High vs Muse Wonder Full low
No clear quality winner: Muse Wonder Full low won 10, Grok 4.7 High won 4, 6 tied, 4 undecided; Grok 4.7 High leads on agent time: 1.1× faster; Muse Wonder Full low’s cost wasn’t recorded.
Stet score
Grok 4.7 Highcursor · high reasoningRank 5 of 16
62.195% range 51.7–71.7
Muse Wonder Full lowmuse · low reasoningRank 1 of 16
72.495% range 60.4–83.310.3 points higher
Quality
Head-to-head matchups
Grok 4.7 High won4
Tied64 undecided
Muse Wonder Full low won10
Task by task
Grok 4.7 High solved 1 task that Muse Wonder Full low didn’t, and Muse Wonder Full low solved 2 that Grok 4.7 High didn’t. Both solved 10; neither solved 7.
Grok 4.7 High only 1
stet-6f84e978Passed tests
Muse Wonder Full low only 2
stet-43493c52Passed testsstet-commit-e928166fEquivalent to the merged fix
A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change, as in the leaderboard’s Solved column. Stet score also weighs code quality, so it can order the two differently. 4 of the 24 tasks are left out because one of the two has no scored result on them.
All 20 compared tasks
| Task | Grok 4.7 High | Muse Wonder Full low | Solved by |
|---|---|---|---|
stet-3169aefa | Passed tests | Passed tests | Both |
stet-89dfbc27 | Passed tests | Passed tests | Both |
stet-b28f4fe7 | Passed tests | Passed tests | Both |
stet-232b50ba | Passed tests | Passed tests | Both |
stet-5276aa3f | Passed tests | Passed tests | Both |
stet-commit-bbbbae09 | Passed tests | Passed tests | Both |
stet-66762b4c | Passed tests | Equivalent to the merged fix | Both |
stet-15439c21 | Passed tests | Passed tests | Both |
stet-commit-5d766dde | Equivalent to the merged fix | Equivalent to the merged fix | Both |
stet-43493c52 | Failed | Passed tests | Muse Wonder Full low only |
stet-6f84e978 | Passed tests | Failed | Grok 4.7 High only |
stet-2450ca2d | Passed tests | Passed tests | Both |
stet-commit-342d0ac0 | Failed | Failed | Neither |
stet-commit-60a0e6c2 | Failed | Failed | Neither |
stet-commit-5e075641 | Failed | Failed | Neither |
stet-commit-a8716b88 | Failed | Failed | Neither |
stet-commit-e928166f | Failed | Equivalent to the merged fix | Muse Wonder Full low only |
stet-commit-30506f8e | Failed | Failed | Neither |
stet-commit-d2ab0c25 | Failed | Failed | Neither |
stet-commit-e41c2e2d | Failed | Failed | Neither |
Side by side
| Metric | Grok 4.7 High | Muse Wonder Full low |
|---|---|---|
| Harness | cursor | muse |
| Reasoning effort | high | low |
| Rank | 5 of 16 | 1 of 16 |
| Stet score | 62.195% range 51.7–71.7 | 72.495% range 60.4–83.3 |
| Solved | 13/2411 passed, 2 judged equivalent | 12/249 passed, 3 judged equivalent |
| Cost / task | $5.76 | not recorded |
| Agent time / task | 18.9 min | 21.6 min |
See which setup wins on your repo
Stet replays your merged PRs, scores quality above pass/fail, and delivers comparison reports through your agent.
Run it on your repoAbout this data
- 24 tasks, each a merged change replayed from the repo as it was just before the merge.
- Data from .
- Both setups come from the same leaderboard run of 16 setups:
bmk_d4ba310fdf50db4ccb2092e3.