# GPT 5.6 Luna low vs GPT 6.1 Sol medium

Stet publishes a public search API over its indexed pages; the guide is at https://www.stet.sh/agents/agent-access.

Source: https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-gpt-6-1-sol-medium
Source observed: 2026-11-19T11:08:36.847Z
Last checked: 2026-11-19T11:08:36.847+00:00
Indexed: 2026-11-19T11:14:59.588+00:00

---

# GPT 5.6 Luna low vs GPT 6.1 Sol medium

We compare GPT 5.6 Luna low and GPT 6.1 Sol medium on real repository work. GPT 5.6 Luna low led on speed and cost, with no clear quality difference. The comparison covers 24 merged changes in our private `Stet-AI/stet` repository, with data from November 19, 2026.

[GPT 5.6 Luna vs GPT 6.1 Sol: all effort pairings](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-vs-gpt-6-1-sol)

## Headline results

| Measure | Result |
| --- | --- |
| Quality | Even; no clear difference; GPT 5.6 Luna low won 2, 16 tied, GPT 6.1 Sol medium won 6 |
| Speed | GPT 5.6 Luna low was 1.8× faster: 6.7 min vs 11.8 min per task |
| Cost | GPT 5.6 Luna low was 22× cheaper: $0.05 vs $1.10 per task |

## What this comparison is

- **1 real repository:** private `Stet-AI/stet`; no public benchmark scores.
- **24 merged changes:** each setup ran end to end from the repository state before the change.
- **Grading:** the repository’s tests and judges compared each patch with the merged change.
- **Measures:** quality, cost, and time from real agent work on a real codebase.

Data: November 19, 2026. The Stet score is a setup’s average chance of beating another setup on a task, from 0 to 100; 50 is even with the field.

## Stet score and quality

| Setup | Harness and effort | Rank | Stet score |
| --- | --- | --- | --- |
| GPT 5.6 Luna low | `codex · low reasoning` | 17 of 18 | 43.5, 95% range 36.7–50.2 |
| GPT 6.1 Sol medium | `codex · medium reasoning` | 4 of 18 | 54.7, 95% range 46.0–63.4 |

Their 95% score ranges overlap. GPT 6.1 Sol medium’s win share was 60%, with a 95% range of 49–71%. Ties are within judge noise.

### Other quality measures

| Metric | GPT 5.6 Luna low | GPT 6.1 Sol medium |
| --- | ---: | ---: |
| Code review pass rate | 29% of 24 tasks | 43% of 23 tasks |
| Checklist score | 0.60 across 24 tasks | 0.88 across 24 tasks |
| Equivalence rate | 38% of 24 tasks | 43% of 23 tasks |

These measures are not part of the headline Stet score and have no confidence interval. A small gap may be noise; the higher recorded value is not a proven lead.

## Task by task

GPT 5.6 Luna low solved 2 tasks that GPT 6.1 Sol medium did not. GPT 6.1 Sol medium solved 3 that GPT 5.6 Luna low did not. Both solved 8; neither solved 11. Of the 8 tasks both solved, judges preferred GPT 6.1 Sol medium’s patch on 1 and called 7 even.

### 2 — Only GPT 5.6 Luna low solved

- 5 changed lines in 2 files — `stet-15439c21` (judges preferred GPT 5.6 Luna low’s patch)
- 113 changed lines in 4 files — `stet-commit-f0caded9` (judges preferred GPT 5.6 Luna low’s patch)

### 3 — Only GPT 6.1 Sol medium solved

- 640 changed lines in 8 files — `stet-commit-342d0ac0` (judges preferred GPT 6.1 Sol medium’s patch)
- 941 changed lines in 7 files — `stet-commit-bbbbae09` (judges preferred GPT 6.1 Sol medium’s patch)
- 1,312 changed lines in 9 files — `stet-commit-f8ae1177` (judges preferred GPT 6.1 Sol medium’s patch)

### 8 — Both solved

- 4 changed lines in 1 file — `stet-43493c52`
- 6 changed lines in 1 file — `stet-3169aefa`
- 9 changed lines in 1 file — `stet-89dfbc27`
- 10 changed lines in 1 file — `stet-232b50ba`
- 23 changed lines in 2 files — `stet-5276aa3f`
- 29 changed lines in 1 file — `stet-b28f4fe7`
- 84 changed lines in 1 file — `stet-66762b4c` (judges preferred GPT 6.1 Sol medium’s patch)
- 218 changed lines in 2 files — `stet-commit-5d766dde`

### 11 — Neither solved

- 2 changed lines in 1 file — `stet-2450ca2d`
- 23 changed lines in 1 file — `stet-6f84e978`
- 149 changed lines in 2 files — `stet-commit-e928166f` (judges preferred GPT 6.1 Sol medium’s patch)
- 476 changed lines in 17 files — `stet-commit-30506f8e`
- 481 changed lines in 3 files — `stet-commit-5e075641`
- 552 changed lines in 11 files — `stet-commit-60a0e6c2`
- 564 changed lines in 10 files — `stet-commit-a8716b88`
- 763 changed lines in 8 files — `stet-commit-87814583`
- 977 changed lines in 5 files — `stet-commit-e41c2e2d`
- 1,236 changed lines in 16 files — `stet-commit-d2ab0c25`
- 1,420 changed lines in 19 files — `stet-commit-2826765e` (judges preferred GPT 6.1 Sol medium’s patch)

A task counts as solved when its tests passed or a judge found the fix equivalent to the merged change. Stet score also weighs code quality, so it can order setups differently.

## Cost and time on each task

Each task is shown on a log scale; filled means the setup solved it and hollow means it did not. The line marks the median.

- **GPT 5.6 Luna low cost:** mean $0.05; median $0.04. It cost less on all 24 tasks.
- **GPT 6.1 Sol medium cost:** mean $1.10; median $0.84.
- **GPT 5.6 Luna low agent time:** mean 6.7 min; median 6.2 min. It finished faster on 15 of 24 tasks.
- **GPT 6.1 Sol medium agent time:** mean 11.8 min; median 11.0 min. It finished faster on 9 tasks.

## Where each setup is the better choice

These groups contain fewer tasks than the overall standings and are leads to test on your repository.

### Small fixes

10 tasks, with 2–84 changed lines in 1–2 files. GPT 5.6 Luna low solved more, 8/10 to 7/10, at 13× lower cost per task. GPT 6.1 Sol medium was 1.4× faster.

| | GPT 5.6 Luna low | GPT 6.1 Sol medium |
| --- | ---: | ---: |
| Solved | 8/10 | 7/10 |
| Cost / task | $0.03 | $0.40 |
| Agent time / task | 7.0 min | 5.1 min |

### Large, cross-cutting changes

14 tasks, with 113–1,420 changed lines in up to 19 files. GPT 6.1 Sol medium solved 2 more, 4/14 to 2/14. GPT 5.6 Luna low cost 25× less per task and was 2.6× faster.

| | GPT 5.6 Luna low | GPT 6.1 Sol medium |
| --- | ---: | ---: |
| Solved | 2/14 | 4/14 |
| Cost / task | $0.07 | $1.60 |
| Agent time / task | 6.4 min | 16.5 min |

## Side by side

| Metric | GPT 5.6 Luna low | GPT 6.1 Sol medium |
| --- | --- | --- |
| Harness | `codex` | `codex` |
| Reasoning effort | low | medium |
| Rank | 17 of 18 | 4 of 18 |
| Stet score | 43.5, 95% range 36.7–50.2 | 54.7, 95% range 46.0–63.4 |
| Solved | 10/24: 7 passed, 3 judged equivalent | 11/24: 9 passed, 2 judged equivalent |
| Cost / task | $0.05 | $1.10 |
| Agent time / task | 6.7 min | 11.8 min |

## Questions

**Which is better for coding?**

There was no clear quality difference: GPT 6.1 Sol medium won 6, GPT 5.6 Luna low won 2, and 16 were tied. GPT 5.6 Luna low led on cost and agent time at 22× cheaper and 1.8× faster.

**How were they tested?**

Both coding agents worked on the same 24 merged changes from the private `Stet-AI/stet` repository, each in the real repository state before the change. The repository’s tests and judges graded every patch against the merged change; no public benchmark scores are used.

## See which setup wins on your repository

We replay your merged changes, score quality above pass/fail, and deliver comparison reports through your agent. [Get started](https://www.stet.sh/private)

## About this data

- 24 tasks from private `Stet-AI/stet`, replayed from the repository state just before each change.
- Data from November 19, 2026.
- Both setups came from leaderboard run `bmk_d4ba310fdf50db4ccb2092e3`.

[See all 18 setups on the leaderboard](https://www.stet.sh/leaderboard) · [How Stet measures](https://www.stet.sh/methodology)

## Research on these models

- [Cost per successful task ranked the coding agent that lost every head to head 1st](https://www.stet.sh/blog/cost-per-successful-task)
- [A benchmark mined from my own repo agreed with FrontierCode](https://www.stet.sh/blog/benchmark-agreed-with-frontier-code)
- [I ran GPT 6.1 Sol against GPT 6 Sol on 24 tasks from my own repo, and found that it maintained quality while cutting cost in half](https://www.stet.sh/blog/gpt-6-1-sol-vs-gpt-6-sol)

## More comparisons

- [GPT 5.6 Luna low vs Haiku 5.5 low](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-haiku-5-5-low)
- [GPT 5.6 Luna low vs GPT 6 Luna low](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-gpt-6-luna-low)
- [GPT 5.6 Luna low vs GPT 6 Luna max](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-gpt-6-luna-max)
- [GPT 5.6 Luna low vs GPT 5.6 Luna max](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-gpt-5-6-luna-max)
- [GPT 5.6 Luna low vs Opus 4.8 medium](https://www.stet.sh/leaderboard/compare/gpt-5-6-luna-low-vs-opus-4-8-medium)
- [GPT 6.1 Sol medium vs Muse Wonder Full low](https://www.stet.sh/leaderboard/compare/gpt-6-1-sol-medium-vs-muse-wonder-full-low)
- [GPT 6.1 Sol medium vs GPT 6 Sol medium](https://www.stet.sh/leaderboard/compare/gpt-6-1-sol-medium-vs-gpt-6-sol-medium)
- [GPT 6.1 Sol medium vs Opus 5 medium](https://www.stet.sh/leaderboard/compare/gpt-6-1-sol-medium-vs-opus-5-medium)
- [GPT 6.1 Sol medium vs Grok 4.7 high](https://www.stet.sh/leaderboard/compare/gpt-6-1-sol-medium-vs-grok-4-7-high)
- [GPT 6.1 Sol medium vs SWE-2 Max high](https://www.stet.sh/leaderboard/compare/gpt-6-1-sol-medium-vs-swe-2-max-high)
- [All 153 comparisons](https://www.stet.sh/leaderboard/compare)

---

[Read this page’s summary](https://www.stet.sh/agents/api/public/v1/page-tldr?url=https%3A%2F%2Fwww.stet.sh%2Fleaderboard%2Fcompare%2Fgpt-5-6-luna-low-vs-gpt-6-1-sol-medium&trace=t_5da45423e484)

## Ask a follow-up about this page

Need a more specific answer? Ask the exact question you have. It returns a fresh, cited answer from Stet’s knowledge base. No account or API key required.

Open this URL with your own question, URL-encoded. Include your question in q. All research inputs are optional; no account or setup.

`GET https://www.stet.sh/agents/agent/faq?q={question}&trace=t_5da45423e484`

[Tool guide and examples](https://www.stet.sh/agents/agent-access) · [OpenAPI](https://www.stet.sh/agents/api/public/v1/openapi.json) · [Page TLDR form](https://www.stet.sh/agents/agent-tools/page-tldr?url=https%3A%2F%2Fwww.stet.sh%2Fleaderboard%2Fcompare%2Fgpt-5-6-luna-low-vs-gpt-6-1-sol-medium). Opening a form does not execute a tool.