Compare 14 AI coding setups, two at a time
Each page puts two leaderboard setups side by side on the same 24 tasks: Stet score, cost, agent time and which tasks each solved.
- Leads, 95% ranges apart
- Leads, ranges overlap
- Tie
- Trails, ranges overlap
- Trails, 95% ranges apart
- No Stet score
1SWE-2 Max
- SWE-2 Max vs GPT 6.1 Sol medium, Leads, ranges overlap
- SWE-2 Max vs Opus 5, Leads, ranges overlap
- SWE-2 Max vs Grok 4.7 High, Leads, ranges overlap
- SWE-2 Max vs Pareto 26.9, Leads, ranges overlap
- SWE-2 Max vs Haiku 5.5 max, Leads, ranges overlap
- SWE-2 Max vs GPT 6 Sol medium, Leads, ranges overlap
- SWE-2 Max vs GPT 6 Luna max, Leads, ranges overlap
- SWE-2 Max vs DeepSeek V4.1 Flash, Leads, ranges overlap
- SWE-2 Max vs Haiku 5.5 low, Leads, 95% ranges apart
- SWE-2 Max vs Opus 4.8, Leads, 95% ranges apart
- SWE-2 Max vs Muse control, Leads, 95% ranges apart
- SWE-2 Max vs GLM 5.3 Flash, Leads, 95% ranges apart
- SWE-2 Max vs GPT 6 Luna low, Leads, 95% ranges apart
2GPT 6.1 Sol medium
- GPT 6.1 Sol medium vs SWE-2 Max, Trails, ranges overlap
- GPT 6.1 Sol medium vs Opus 5, Leads, ranges overlap
- GPT 6.1 Sol medium vs Grok 4.7 High, Leads, ranges overlap
- GPT 6.1 Sol medium vs Pareto 26.9, Leads, ranges overlap
- GPT 6.1 Sol medium vs Haiku 5.5 max, Leads, ranges overlap
- GPT 6.1 Sol medium vs GPT 6 Sol medium, Leads, ranges overlap
- GPT 6.1 Sol medium vs GPT 6 Luna max, Leads, ranges overlap
- GPT 6.1 Sol medium vs DeepSeek V4.1 Flash, Leads, ranges overlap
- GPT 6.1 Sol medium vs Haiku 5.5 low, Leads, 95% ranges apart
- GPT 6.1 Sol medium vs Opus 4.8, Leads, 95% ranges apart
- GPT 6.1 Sol medium vs Muse control, Leads, 95% ranges apart
- GPT 6.1 Sol medium vs GLM 5.3 Flash, Leads, 95% ranges apart
- GPT 6.1 Sol medium vs GPT 6 Luna low, Leads, 95% ranges apart
3Opus 5
- Opus 5 vs SWE-2 Max, Trails, ranges overlap
- Opus 5 vs GPT 6.1 Sol medium, Trails, ranges overlap
- Opus 5 vs Grok 4.7 High, Leads, ranges overlap
- Opus 5 vs Pareto 26.9, Leads, ranges overlap
- Opus 5 vs Haiku 5.5 max, Leads, ranges overlap
- Opus 5 vs GPT 6 Sol medium, Leads, ranges overlap
- Opus 5 vs GPT 6 Luna max, Leads, ranges overlap
- Opus 5 vs DeepSeek V4.1 Flash, Leads, ranges overlap
- Opus 5 vs Haiku 5.5 low, Leads, 95% ranges apart
- Opus 5 vs Opus 4.8, Leads, 95% ranges apart
- Opus 5 vs Muse control, Leads, 95% ranges apart
- Opus 5 vs GLM 5.3 Flash, Leads, 95% ranges apart
- Opus 5 vs GPT 6 Luna low, Leads, 95% ranges apart
4Grok 4.7 High
- Grok 4.7 High vs SWE-2 Max, Trails, ranges overlap
- Grok 4.7 High vs GPT 6.1 Sol medium, Trails, ranges overlap
- Grok 4.7 High vs Opus 5, Trails, ranges overlap
- Grok 4.7 High vs Pareto 26.9, Leads, ranges overlap
- Grok 4.7 High vs Haiku 5.5 max, Leads, ranges overlap
- Grok 4.7 High vs GPT 6 Sol medium, Leads, ranges overlap
- Grok 4.7 High vs GPT 6 Luna max, Leads, ranges overlap
- Grok 4.7 High vs DeepSeek V4.1 Flash, Leads, ranges overlap
- Grok 4.7 High vs Haiku 5.5 low, Leads, 95% ranges apart
- Grok 4.7 High vs Opus 4.8, Leads, 95% ranges apart
- Grok 4.7 High vs Muse control, Leads, 95% ranges apart
- Grok 4.7 High vs GLM 5.3 Flash, Leads, 95% ranges apart
- Grok 4.7 High vs GPT 6 Luna low, Leads, 95% ranges apart
5Pareto 26.9
- Pareto 26.9 vs SWE-2 Max, Trails, ranges overlap
- Pareto 26.9 vs GPT 6.1 Sol medium, Trails, ranges overlap
- Pareto 26.9 vs Opus 5, Trails, ranges overlap
- Pareto 26.9 vs Grok 4.7 High, Trails, ranges overlap
- Pareto 26.9 vs Haiku 5.5 max, Leads, ranges overlap
- Pareto 26.9 vs GPT 6 Sol medium, Leads, ranges overlap
- Pareto 26.9 vs GPT 6 Luna max, Leads, ranges overlap
- Pareto 26.9 vs DeepSeek V4.1 Flash, Leads, ranges overlap
- Pareto 26.9 vs Haiku 5.5 low, Leads, 95% ranges apart
- Pareto 26.9 vs Opus 4.8, Leads, ranges overlap
- Pareto 26.9 vs Muse control, Leads, 95% ranges apart
- Pareto 26.9 vs GLM 5.3 Flash, Leads, 95% ranges apart
- Pareto 26.9 vs GPT 6 Luna low, Leads, 95% ranges apart
6Haiku 5.5 max
- Haiku 5.5 max vs SWE-2 Max, Trails, ranges overlap
- Haiku 5.5 max vs GPT 6.1 Sol medium, Trails, ranges overlap
- Haiku 5.5 max vs Opus 5, Trails, ranges overlap
- Haiku 5.5 max vs Grok 4.7 High, Trails, ranges overlap
- Haiku 5.5 max vs Pareto 26.9, Trails, ranges overlap
- Haiku 5.5 max vs GPT 6 Sol medium, Leads, ranges overlap
- Haiku 5.5 max vs GPT 6 Luna max, Leads, ranges overlap
- Haiku 5.5 max vs DeepSeek V4.1 Flash, Leads, ranges overlap
- Haiku 5.5 max vs Haiku 5.5 low, Leads, ranges overlap
- Haiku 5.5 max vs Opus 4.8, Leads, ranges overlap
- Haiku 5.5 max vs Muse control, Leads, 95% ranges apart
- Haiku 5.5 max vs GLM 5.3 Flash, Leads, 95% ranges apart
- Haiku 5.5 max vs GPT 6 Luna low, Leads, 95% ranges apart
7GPT 6 Sol medium
- GPT 6 Sol medium vs SWE-2 Max, Trails, ranges overlap
- GPT 6 Sol medium vs GPT 6.1 Sol medium, Trails, ranges overlap
- GPT 6 Sol medium vs Opus 5, Trails, ranges overlap
- GPT 6 Sol medium vs Grok 4.7 High, Trails, ranges overlap
- GPT 6 Sol medium vs Pareto 26.9, Trails, ranges overlap
- GPT 6 Sol medium vs Haiku 5.5 max, Trails, ranges overlap
- GPT 6 Sol medium vs GPT 6 Luna max, Leads, ranges overlap
- GPT 6 Sol medium vs DeepSeek V4.1 Flash, Leads, ranges overlap
- GPT 6 Sol medium vs Haiku 5.5 low, Leads, 95% ranges apart
- GPT 6 Sol medium vs Opus 4.8, Leads, ranges overlap
- GPT 6 Sol medium vs Muse control, Leads, 95% ranges apart
- GPT 6 Sol medium vs GLM 5.3 Flash, Leads, 95% ranges apart
- GPT 6 Sol medium vs GPT 6 Luna low, Leads, 95% ranges apart
8GPT 6 Luna max
- GPT 6 Luna max vs SWE-2 Max, Trails, ranges overlap
- GPT 6 Luna max vs GPT 6.1 Sol medium, Trails, ranges overlap
- GPT 6 Luna max vs Opus 5, Trails, ranges overlap
- GPT 6 Luna max vs Grok 4.7 High, Trails, ranges overlap
- GPT 6 Luna max vs Pareto 26.9, Trails, ranges overlap
- GPT 6 Luna max vs Haiku 5.5 max, Trails, ranges overlap
- GPT 6 Luna max vs GPT 6 Sol medium, Trails, ranges overlap
- GPT 6 Luna max vs DeepSeek V4.1 Flash, Leads, ranges overlap
- GPT 6 Luna max vs Haiku 5.5 low, Leads, ranges overlap
- GPT 6 Luna max vs Opus 4.8, Leads, ranges overlap
- GPT 6 Luna max vs Muse control, Leads, ranges overlap
- GPT 6 Luna max vs GLM 5.3 Flash, Leads, ranges overlap
- GPT 6 Luna max vs GPT 6 Luna low, Leads, 95% ranges apart
9DeepSeek V4.1 Flash
- DeepSeek V4.1 Flash vs SWE-2 Max, Trails, ranges overlap
- DeepSeek V4.1 Flash vs GPT 6.1 Sol medium, Trails, ranges overlap
- DeepSeek V4.1 Flash vs Opus 5, Trails, ranges overlap
- DeepSeek V4.1 Flash vs Grok 4.7 High, Trails, ranges overlap
- DeepSeek V4.1 Flash vs Pareto 26.9, Trails, ranges overlap
- DeepSeek V4.1 Flash vs Haiku 5.5 max, Trails, ranges overlap
- DeepSeek V4.1 Flash vs GPT 6 Sol medium, Trails, ranges overlap
- DeepSeek V4.1 Flash vs GPT 6 Luna max, Trails, ranges overlap
- DeepSeek V4.1 Flash vs Haiku 5.5 low, Leads, ranges overlap
- DeepSeek V4.1 Flash vs Opus 4.8, Leads, ranges overlap
- DeepSeek V4.1 Flash vs Muse control, Leads, ranges overlap
- DeepSeek V4.1 Flash vs GLM 5.3 Flash, Leads, ranges overlap
- DeepSeek V4.1 Flash vs GPT 6 Luna low, Leads, 95% ranges apart
10Haiku 5.5 low
- Haiku 5.5 low vs SWE-2 Max, Trails, 95% ranges apart
- Haiku 5.5 low vs GPT 6.1 Sol medium, Trails, 95% ranges apart
- Haiku 5.5 low vs Opus 5, Trails, 95% ranges apart
- Haiku 5.5 low vs Grok 4.7 High, Trails, 95% ranges apart
- Haiku 5.5 low vs Pareto 26.9, Trails, 95% ranges apart
- Haiku 5.5 low vs Haiku 5.5 max, Trails, ranges overlap
- Haiku 5.5 low vs GPT 6 Sol medium, Trails, 95% ranges apart
- Haiku 5.5 low vs GPT 6 Luna max, Trails, ranges overlap
- Haiku 5.5 low vs DeepSeek V4.1 Flash, Trails, ranges overlap
- Haiku 5.5 low vs Opus 4.8, Leads, ranges overlap
- Haiku 5.5 low vs Muse control, Leads, ranges overlap
- Haiku 5.5 low vs GLM 5.3 Flash, Leads, ranges overlap
- Haiku 5.5 low vs GPT 6 Luna low, Leads, 95% ranges apart
11Opus 4.8
- Opus 4.8 vs SWE-2 Max, Trails, 95% ranges apart
- Opus 4.8 vs GPT 6.1 Sol medium, Trails, 95% ranges apart
- Opus 4.8 vs Opus 5, Trails, 95% ranges apart
- Opus 4.8 vs Grok 4.7 High, Trails, 95% ranges apart
- Opus 4.8 vs Pareto 26.9, Trails, ranges overlap
- Opus 4.8 vs Haiku 5.5 max, Trails, ranges overlap
- Opus 4.8 vs GPT 6 Sol medium, Trails, ranges overlap
- Opus 4.8 vs GPT 6 Luna max, Trails, ranges overlap
- Opus 4.8 vs DeepSeek V4.1 Flash, Trails, ranges overlap
- Opus 4.8 vs Haiku 5.5 low, Trails, ranges overlap
- Opus 4.8 vs Muse control, Leads, ranges overlap
- Opus 4.8 vs GLM 5.3 Flash, Leads, ranges overlap
- Opus 4.8 vs GPT 6 Luna low, Leads, ranges overlap
12Muse control
- Muse control vs SWE-2 Max, Trails, 95% ranges apart
- Muse control vs GPT 6.1 Sol medium, Trails, 95% ranges apart
- Muse control vs Opus 5, Trails, 95% ranges apart
- Muse control vs Grok 4.7 High, Trails, 95% ranges apart
- Muse control vs Pareto 26.9, Trails, 95% ranges apart
- Muse control vs Haiku 5.5 max, Trails, 95% ranges apart
- Muse control vs GPT 6 Sol medium, Trails, 95% ranges apart
- Muse control vs GPT 6 Luna max, Trails, ranges overlap
- Muse control vs DeepSeek V4.1 Flash, Trails, ranges overlap
- Muse control vs Haiku 5.5 low, Trails, ranges overlap
- Muse control vs Opus 4.8, Trails, ranges overlap
- Muse control vs GLM 5.3 Flash, Leads, ranges overlap
- Muse control vs GPT 6 Luna low, Leads, ranges overlap
13GLM 5.3 Flash
- GLM 5.3 Flash vs SWE-2 Max, Trails, 95% ranges apart
- GLM 5.3 Flash vs GPT 6.1 Sol medium, Trails, 95% ranges apart
- GLM 5.3 Flash vs Opus 5, Trails, 95% ranges apart
- GLM 5.3 Flash vs Grok 4.7 High, Trails, 95% ranges apart
- GLM 5.3 Flash vs Pareto 26.9, Trails, 95% ranges apart
- GLM 5.3 Flash vs Haiku 5.5 max, Trails, 95% ranges apart
- GLM 5.3 Flash vs GPT 6 Sol medium, Trails, 95% ranges apart
- GLM 5.3 Flash vs GPT 6 Luna max, Trails, ranges overlap
- GLM 5.3 Flash vs DeepSeek V4.1 Flash, Trails, ranges overlap
- GLM 5.3 Flash vs Haiku 5.5 low, Trails, ranges overlap
- GLM 5.3 Flash vs Opus 4.8, Trails, ranges overlap
- GLM 5.3 Flash vs Muse control, Trails, ranges overlap
- GLM 5.3 Flash vs GPT 6 Luna low, Leads, ranges overlap
14GPT 6 Luna low
- GPT 6 Luna low vs SWE-2 Max, Trails, 95% ranges apart
- GPT 6 Luna low vs GPT 6.1 Sol medium, Trails, 95% ranges apart
- GPT 6 Luna low vs Opus 5, Trails, 95% ranges apart
- GPT 6 Luna low vs Grok 4.7 High, Trails, 95% ranges apart
- GPT 6 Luna low vs Pareto 26.9, Trails, 95% ranges apart
- GPT 6 Luna low vs Haiku 5.5 max, Trails, 95% ranges apart
- GPT 6 Luna low vs GPT 6 Sol medium, Trails, 95% ranges apart
- GPT 6 Luna low vs GPT 6 Luna max, Trails, 95% ranges apart
- GPT 6 Luna low vs DeepSeek V4.1 Flash, Trails, 95% ranges apart
- GPT 6 Luna low vs Haiku 5.5 low, Trails, 95% ranges apart
- GPT 6 Luna low vs Opus 4.8, Trails, ranges overlap
- GPT 6 Luna low vs Muse control, Trails, ranges overlap
- GPT 6 Luna low vs GLM 5.3 Flash, Trails, ranges overlap