{"benchmark":{"repository":"Stet-AI/stet","boardId":"bmk_d4ba310fdf50db4ccb2092e3","inspection":{"message":"The decision receipt requires inspection; no setup is recommended for adoption.","nextAction":"Inspect the recorded comparisons and measure on your own repository."},"rankedAt":"2026-10-20T21:49:46Z","tasks":[{"id":"stet-15439c21","passedBy":10},{"id":"stet-232b50ba","passedBy":14},{"id":"stet-2450ca2d","passedBy":5},{"id":"stet-3169aefa","passedBy":15},{"id":"stet-43493c52","passedBy":10},{"id":"stet-5276aa3f","passedBy":14},{"id":"stet-66762b4c","passedBy":11},{"id":"stet-6f84e978","passedBy":6},{"id":"stet-89dfbc27","passedBy":15},{"id":"stet-b28f4fe7","passedBy":15},{"id":"stet-commit-2826765e","passedBy":0},{"id":"stet-commit-30506f8e","passedBy":0},{"id":"stet-commit-342d0ac0","passedBy":0},{"id":"stet-commit-5d766dde","passedBy":2},{"id":"stet-commit-5e075641","passedBy":1},{"id":"stet-commit-60a0e6c2","passedBy":2},{"id":"stet-commit-87814583","passedBy":0},{"id":"stet-commit-a8716b88","passedBy":0},{"id":"stet-commit-bbbbae09","passedBy":14},{"id":"stet-commit-d2ab0c25","passedBy":0},{"id":"stet-commit-e41c2e2d","passedBy":0},{"id":"stet-commit-e928166f","passedBy":0},{"id":"stet-commit-f0caded9","passedBy":5},{"id":"stet-commit-f8ae1177","passedBy":6}],"setups":[{"label":"SWE-2 Max","model":"swe-2-max","harness":"devin","reasoning":"high","rank":1,"rankWithheld":null,"score":66.66323261422254,"scoreLow":56.767687910537255,"scoreHigh":75.9255184640707,"passed":13,"matched":3,"failed":8,"unscored":0,"costPerTaskUsd":null,"costTasks":null,"secondsPerTask":4095.430673875,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":true},"addedBy":null,"outcomes":["equivalent","pass","pass","pass","fail","pass","pass","pass","pass","pass","fail","fail","equivalent","pass","pass","pass","fail","equivalent","pass","fail","fail","fail","pass","fail"]},{"label":"GPT 6.1 Sol medium","model":"gpt-6.1-sol","harness":"codex","reasoning":"medium","rank":2,"rankWithheld":null,"score":65.8181089566129,"scoreLow":55.99963701111391,"scoreHigh":75.0637289076529,"passed":10,"matched":3,"failed":11,"unscored":0,"costPerTaskUsd":1.1001853166666666,"costTasks":24,"secondsPerTask":706.5696947499999,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","pass","pass","pass","equivalent","pass","pass","fail","fail","equivalent","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","fail","pass"]},{"label":"Opus 5","model":"claude-opus-5","harness":null,"reasoning":"medium","rank":3,"rankWithheld":null,"score":65.69757852498009,"scoreLow":55.314482525617095,"scoreHigh":75.45338864089614,"passed":12,"matched":2,"failed":10,"unscored":0,"costPerTaskUsd":6.775694875,"costTasks":24,"secondsPerTask":1392.1739852499998,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","pass","pass","pass","pass","pass","pass","pass","pass","equivalent","fail","fail","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","pass","fail"]},{"label":"Grok 4.7 High","model":"grok-4.7-high","harness":"cursor","reasoning":"high","rank":4,"rankWithheld":null,"score":63.995853483736674,"scoreLow":53.244729286336394,"scoreHigh":73.78731269783978,"passed":11,"matched":2,"failed":11,"unscored":0,"costPerTaskUsd":5.756040583333333,"costTasks":24,"secondsPerTask":1135.2941512083332,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","pass","pass","fail","pass","pass","pass","pass","pass","fail","fail","fail","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","pass"]},{"label":"Pareto 26.9","model":"union-alpha","harness":"claude-code","reasoning":"medium","rank":5,"rankWithheld":null,"score":59.96042354761678,"scoreLow":49.51342513720855,"scoreHigh":70.03451738455564,"passed":12,"matched":1,"failed":11,"unscored":0,"costPerTaskUsd":12.473882083333331,"costTasks":24,"secondsPerTask":2351.1423172083337,"secondsTasks":24,"pareto":{"frontier":false,"dominatedBy":"Opus 5","pQuality":0.8019,"pCost":0.9999,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","pass","pass","pass","pass","pass","pass","pass","pass","fail","fail","fail","fail","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","pass"]},{"label":"Haiku 5.5 max","model":"claude-haiku-5-5","harness":"claude-code","reasoning":"max","rank":6,"rankWithheld":null,"score":58.8922519672093,"scoreLow":47.61954090734049,"scoreHigh":69.39316529487827,"passed":9,"matched":3,"failed":11,"unscored":1,"costPerTaskUsd":3.8496577337499995,"costTasks":24,"secondsPerTask":3504.0694999166667,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","fail","pass","pass","fail","pass","fail","equivalent","pass","pass","fail","fail","equivalent","equivalent","fail","none","fail","fail","pass","fail","fail","fail","pass","pass"]},{"label":"GPT 6 Sol medium","model":"gpt-6-sol","harness":"codex","reasoning":"medium","rank":7,"rankWithheld":null,"score":58.49678755311114,"scoreLow":50.61320308914897,"scoreHigh":66.31730291205092,"passed":11,"matched":3,"failed":10,"unscored":0,"costPerTaskUsd":3.0076576666666672,"costTasks":24,"secondsPerTask":925.1477994166665,"secondsTasks":24,"pareto":{"frontier":false,"dominatedBy":"GPT 6.1 Sol medium","pQuality":0.8709,"pCost":1,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","pass","pass","pass","pass","pass","pass","fail","fail","equivalent","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","pass"]},{"label":"GPT 6 Luna max","model":"gpt-6-luna","harness":"codex","reasoning":"max","rank":8,"rankWithheld":null,"score":50.84341127377248,"scoreLow":41.19908808776324,"scoreHigh":59.98474994508864,"passed":8,"matched":4,"failed":12,"unscored":0,"costPerTaskUsd":0.37428912666666675,"costTasks":24,"secondsPerTask":3583.72035,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["fail","pass","fail","pass","pass","pass","equivalent","fail","pass","pass","fail","fail","equivalent","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","pass"]},{"label":"DeepSeek V4.1 Flash","model":"deepseek-v4-flash","harness":"deepseek-harness","reasoning":"max","rank":9,"rankWithheld":null,"score":48.07878619235621,"scoreLow":37.55460870913852,"scoreHigh":58.47638269001993,"passed":11,"matched":1,"failed":12,"unscored":0,"costPerTaskUsd":0.49174112243478263,"costTasks":23,"secondsPerTask":2956.4312100416664,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","pass","pass","pass","fail","pass","pass","fail","fail","equivalent","pass","fail","fail","fail","fail","pass","fail","fail","fail","pass","fail"]},{"label":"Haiku 5.5 low+guidance","model":"claude-haiku-5-5","harness":"claude-code","reasoning":"low","rank":10,"rankWithheld":null,"score":42.44924451821451,"scoreLow":33.20688075549702,"scoreHigh":51.69183717443924,"passed":8,"matched":1,"failed":15,"unscored":0,"costPerTaskUsd":0.28660014,"costTasks":24,"secondsPerTask":743.3112249583334,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["fail","pass","fail","pass","pass","pass","pass","fail","pass","pass","fail","fail","fail","fail","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","fail"]},{"label":"Haiku 5.5 low","model":"claude-haiku-5-5","harness":"claude-code","reasoning":"low","rank":11,"rankWithheld":null,"score":41.85765050083281,"scoreLow":35.33599922217494,"scoreHigh":48.49024297414339,"passed":7,"matched":4,"failed":13,"unscored":0,"costPerTaskUsd":0.2506289254166667,"costTasks":24,"secondsPerTask":592.6717039166667,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["equivalent","pass","fail","pass","pass","pass","equivalent","fail","pass","pass","fail","fail","fail","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","equivalent","fail"]},{"label":"Opus 4.8","model":"claude-opus-4-8","harness":"claude-code","reasoning":"medium","rank":12,"rankWithheld":null,"score":40.77904060345771,"scoreLow":30.808811553826907,"scoreHigh":50.92599743346273,"passed":11,"matched":2,"failed":11,"unscored":0,"costPerTaskUsd":7.052225760416667,"costTasks":24,"secondsPerTask":1398.4705882916667,"secondsTasks":24,"pareto":{"frontier":false,"dominatedBy":"GPT 6.1 Sol medium","pQuality":1,"pCost":1,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","pass","pass","pass","pass","pass","pass","fail","fail","fail","equivalent","fail","pass","fail","fail","pass","fail","fail","fail","equivalent","fail"]},{"label":"Muse control","model":"muse-spark-1.3-contributor","harness":"muse","reasoning":"high","rank":13,"rankWithheld":null,"score":34.13938850652553,"scoreLow":25.305831529991423,"scoreHigh":43.27661796776108,"passed":8,"matched":2,"failed":14,"unscored":0,"costPerTaskUsd":0.10014532924999998,"costTasks":24,"secondsPerTask":793.6477202500001,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["fail","pass","equivalent","pass","pass","pass","pass","fail","pass","pass","fail","fail","fail","equivalent","fail","fail","fail","fail","pass","fail","fail","fail","fail","fail"]},{"label":"GLM 5.3 Flash","model":"ox-alpha-free","harness":"codex","reasoning":"high","rank":14,"rankWithheld":null,"score":31.13121874079793,"scoreLow":21.50834805947007,"scoreHigh":41.85361271890834,"passed":9,"matched":0,"failed":15,"unscored":0,"costPerTaskUsd":0.4098502783333333,"costTasks":24,"secondsPerTask":1604.8733137083334,"secondsTasks":24,"pareto":{"frontier":false,"dominatedBy":"Haiku 5.5 low","pQuality":0.9293,"pCost":0.8649,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","fail","pass","pass","fail","pass","pass","fail","fail","fail","fail","fail","fail","fail","fail","pass","fail","fail","fail","pass","fail"]},{"label":"GPT 6 Luna low","model":"gpt-6-luna","harness":"codex","reasoning":"low","rank":15,"rankWithheld":null,"score":21.1970230165534,"scoreLow":12.479182032633314,"scoreHigh":31.2419890001138,"passed":5,"matched":0,"failed":18,"unscored":1,"costPerTaskUsd":0.05334160666666667,"costTasks":24,"secondsPerTask":413.45088725,"secondsTasks":24,"pareto":{"frontier":true,"dominatedBy":null,"pQuality":null,"pCost":null,"unpriced":false},"addedBy":null,"outcomes":["pass","pass","fail","pass","fail","fail","fail","fail","pass","pass","fail","fail","fail","nopatch","fail","none","fail","fail","nopatch","fail","fail","fail","fail","nopatch"]}],"focus":{"arms":[{"label":"SWE-2 Max","score":66.66323261422254,"low":56.767687910537255,"high":75.9255184640707,"leadShare":0.3025,"position":1,"wins":174,"ties":98,"losses":62,"undecided":2,"coverage":0.9940476190476191,"mergeable":7,"mergeableKnown":23,"tokens":5940079.434782608,"tokenTasks":23},{"label":"GPT 6.1 Sol medium","score":65.8181089566129,"low":55.99963701111391,"high":75.0637289076529,"leadShare":0.2715,"position":2,"wins":171,"ties":102,"losses":61,"undecided":2,"coverage":0.9940476190476191,"mergeable":8,"mergeableKnown":24,"cost":1.1001853166666664,"costTasks":24,"tokens":5241611.958333333,"tokenTasks":24},{"label":"Opus 5","score":65.69757852498009,"low":55.314482525617095,"high":75.45338864089614,"leadShare":0.2066,"position":3,"wins":169,"ties":103,"losses":62,"undecided":2,"coverage":0.9940476190476191,"mergeable":7,"mergeableKnown":24,"cost":6.775694875,"costTasks":24,"tokens":9070765.125,"tokenTasks":24},{"label":"Grok 4.7 High","score":63.995853483736674,"low":53.244729286336394,"high":73.78731269783978,"leadShare":0.156,"position":4,"wins":170,"ties":87,"losses":77,"undecided":2,"coverage":0.9940476190476191,"mergeable":6,"mergeableKnown":24,"cost":5.756040583333333,"costTasks":24,"tokens":9690760.875,"tokenTasks":24},{"label":"Pareto 26.9","score":59.96042354761678,"low":49.51342513720855,"high":70.03451738455564,"leadShare":0.047,"position":5,"wins":157,"ties":87,"losses":90,"undecided":2,"coverage":0.9940476190476191,"mergeable":6,"mergeableKnown":24,"cost":12.473882083333331,"costTasks":24,"tokens":8460339.375,"tokenTasks":24},{"label":"Haiku 5.5 max","score":58.8922519672093,"low":47.61954090734049,"high":69.39316529487827,"leadShare":0.0044,"position":6,"wins":143,"ties":92,"losses":87,"undecided":14,"coverage":0.9583333333333334,"mergeable":6,"mergeableKnown":23,"cost":3.8496577337499995,"costTasks":24,"tokens":51666201.75,"tokenTasks":24},{"label":"GPT 6 Sol medium","score":58.49678755311114,"low":50.61320308914897,"high":66.31730291205092,"leadShare":0.0117,"position":7,"wins":142,"ties":110,"losses":82,"undecided":2,"coverage":0.9940476190476191,"mergeable":7,"mergeableKnown":24,"cost":3.007657666666667,"costTasks":24,"tokens":11131064.5,"tokenTasks":24},{"label":"GPT 6 Luna max","score":50.84341127377248,"low":41.19908808776324,"high":59.98474994508864,"leadShare":0.0003,"position":8,"wins":121,"ties":98,"losses":115,"undecided":2,"coverage":0.9940476190476191,"mergeable":5,"mergeableKnown":24,"cost":0.37428912666666675,"costTasks":24,"tokens":22568203.708333332,"tokenTasks":24},{"label":"DeepSeek V4.1 Flash","score":48.07878619235621,"low":37.55460870913852,"high":58.47638269001993,"leadShare":0,"position":9,"wins":116,"ties":90,"losses":128,"undecided":2,"coverage":0.9940476190476191,"mergeable":8,"mergeableKnown":24,"cost":0.49174112243478263,"costTasks":23,"tokens":34995195.347826086,"tokenTasks":23},{"label":"Haiku 5.5 low+guidance","score":42.44924451821451,"low":33.20688075549702,"high":51.69183717443924,"leadShare":0,"position":10,"wins":90,"ties":98,"losses":146,"undecided":2,"coverage":0.9940476190476191,"mergeable":6,"mergeableKnown":24,"cost":0.28660014,"costTasks":24,"tokens":4327286.166666667,"tokenTasks":24},{"label":"Haiku 5.5 low","score":41.85765050083281,"low":35.33599922217494,"high":48.49024297414339,"leadShare":0,"position":11,"wins":87,"ties":114,"losses":133,"undecided":2,"coverage":0.9940476190476191,"mergeable":4,"mergeableKnown":24,"cost":0.2506289254166667,"costTasks":24,"tokens":3989049.75,"tokenTasks":24},{"label":"Opus 4.8","score":40.77904060345771,"low":30.808811553826907,"high":50.92599743346273,"leadShare":0,"position":12,"wins":94,"ties":84,"losses":156,"undecided":2,"coverage":0.9940476190476191,"mergeable":3,"mergeableKnown":24,"cost":7.052225760416667,"costTasks":24,"tokens":8943322.875,"tokenTasks":24},{"label":"Muse control","score":34.13938850652553,"low":25.305831529991423,"high":43.27661796776108,"leadShare":0,"position":13,"wins":66,"ties":86,"losses":182,"undecided":2,"coverage":0.9940476190476191,"mergeable":6,"mergeableKnown":24,"cost":0.10014532924999998,"costTasks":24,"tokens":14517694.583333334,"tokenTasks":24},{"label":"GLM 5.3 Flash","score":31.13121874079793,"low":21.50834805947007,"high":41.85361271890834,"leadShare":0,"position":14,"wins":64,"ties":75,"losses":195,"undecided":2,"coverage":0.9940476190476191,"mergeable":7,"mergeableKnown":24,"cost":0.4098502783333333,"costTasks":24,"tokens":12540530.75,"tokenTasks":24},{"label":"GPT 6 Luna low","score":21.1970230165534,"low":12.479182032633314,"high":31.2419890001138,"leadShare":0,"position":15,"wins":37,"ties":60,"losses":225,"undecided":14,"coverage":0.9583333333333334,"mergeable":5,"mergeableKnown":23,"cost":0.05334160666666667,"costTasks":24,"tokens":3715588.6666666665,"tokenTasks":24}],"pairs":[{"a":"SWE-2 Max","b":"GPT 6.1 Sol medium","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.16175065611707434,"wins":10,"ties":8,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5656843862449151,"winShareLow":0.4019639963346101,"winShareHigh":0.7254653085687588},{"a":"SWE-2 Max","b":"Opus 5","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.15652580997801763,"wins":8,"ties":10,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.5422996318049438,"winShareLow":0.3849836495361453,"winShareHigh":0.6980352694921805},{"a":"SWE-2 Max","b":"Grok 4.7 High","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.1592403407527339,"wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5876309742756701,"winShareLow":0.4279974923660429,"winShareHigh":0.7464781738715107},{"a":"SWE-2 Max","b":"Pareto 26.9","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.16225226369001722,"wins":9,"ties":8,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5575420121330054,"winShareLow":0.3940792417467808,"winShareHigh":0.7185837691268152},{"a":"SWE-2 Max","b":"Haiku 5.5 max","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.14253538945056426,"wins":7,"ties":13,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5781329140604131,"winShareLow":0.4341114178074267,"winShareHigh":0.7191821967085552},{"a":"SWE-2 Max","b":"GPT 6 Sol medium","favors":"SWE-2 Max","separates":false,"separatesRaw":false,"halfWidth":0.1600320729525725,"wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.637402039492738,"winShareLow":0.47287896562501,"winShareHigh":0.792943111530155},{"a":"SWE-2 Max","b":"GPT 6 Luna max","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.14092414418890065,"wins":13,"ties":8,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7090278243709194,"winShareLow":0.561172029930469,"winShareHigh":0.8430203183082703},{"a":"SWE-2 Max","b":"DeepSeek V4.1 Flash","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.149808491421826,"wins":13,"ties":6,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6718198375412999,"winShareLow":0.5167319359563767,"winShareHigh":0.8163489188000287},{"a":"SWE-2 Max","b":"Haiku 5.5 low+guidance","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.15969483314387672,"wins":15,"ties":5,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7058601092058145,"winShareLow":0.5389422098698362,"winShareHigh":0.8583318761575897},{"a":"SWE-2 Max","b":"Haiku 5.5 low","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.15048267866037274,"wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7029172877346469,"winShareLow":0.547873601602169,"winShareHigh":0.8488389589229145},{"a":"SWE-2 Max","b":"Opus 4.8","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.14209907891407758,"wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.758038213384255,"winShareLow":0.6085261388836718,"winShareHigh":0.892724296711827},{"a":"SWE-2 Max","b":"Muse control","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.1422185845554913,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.756430722474183,"winShareLow":0.608541506705985,"winShareHigh":0.8929786758169675},{"a":"SWE-2 Max","b":"GLM 5.3 Flash","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.1374506224155122,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":19,"readCountsPrompts":true,"winShare":0.7774662602210435,"winShareLow":0.6314590482329512,"winShareHigh":0.9063602930639756},{"a":"SWE-2 Max","b":"GPT 6 Luna low","favors":"SWE-2 Max","separates":false,"separatesRaw":true,"halfWidth":0.12928147609399226,"wins":17,"ties":4,"losses":2,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.8289187552645566,"winShareLow":0.6885296404235456,"winShareHigh":0.9470925926115301},{"a":"GPT 6.1 Sol medium","b":"Opus 5","favors":"Opus 5","separates":false,"separatesRaw":false,"halfWidth":0.15446262047121906,"wins":8,"ties":9,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.4962245700363146,"winShareLow":0.3427146454023715,"winShareHigh":0.6516398863448096},{"a":"GPT 6.1 Sol medium","b":"Grok 4.7 High","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.16936635975182754,"wins":10,"ties":5,"losses":9,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5004657553798606,"winShareLow":0.33266755033791146,"winShareHigh":0.6714002698415665},{"a":"GPT 6.1 Sol medium","b":"Pareto 26.9","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.16746462493626174,"wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6066165121883761,"winShareLow":0.4352076235098219,"winShareHigh":0.7701368733823454},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 max","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.1546475549834502,"wins":9,"ties":10,"losses":4,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5891646259817218,"winShareLow":0.43221753127236834,"winShareHigh":0.7415126412392687},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Sol medium","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.14319981564685597,"wins":9,"ties":10,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6253675048444628,"winShareLow":0.4763685386903894,"winShareHigh":0.7627681699841014},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Luna max","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.14185179790039232,"wins":13,"ties":7,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.685800569304063,"winShareLow":0.5376484778226187,"winShareHigh":0.8213520736234033},{"a":"GPT 6.1 Sol medium","b":"DeepSeek V4.1 Flash","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.1399608038301972,"wins":12,"ties":9,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6898567507079987,"winShareLow":0.5446576168517361,"winShareHigh":0.8245792245121305},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 low+guidance","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.13234133210288102,"wins":13,"ties":9,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7255310796453968,"winShareLow":0.5861544815387102,"winShareHigh":0.8508371457444722},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 low","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.11468998213310766,"wins":13,"ties":10,"losses":1,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7825388822521558,"winShareLow":0.6596802426857694,"winShareHigh":0.8890602069519847},{"a":"GPT 6.1 Sol medium","b":"Opus 4.8","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.12904668588858992,"wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7740788341660142,"winShareLow":0.6346250824880001,"winShareHigh":0.8927184542651799},{"a":"GPT 6.1 Sol medium","b":"Muse control","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.13667129523917682,"wins":17,"ties":5,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7821356115440485,"winShareLow":0.6367119953169484,"winShareHigh":0.9100545857953021},{"a":"GPT 6.1 Sol medium","b":"GLM 5.3 Flash","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.14388250703938804,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7515990864824446,"winShareLow":0.6008851395959982,"winShareHigh":0.8886501536747743},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Luna low","favors":"GPT 6.1 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.12271045885143117,"wins":17,"ties":5,"losses":1,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.8151214658371062,"winShareLow":0.6846830912060482,"winShareHigh":0.9301040089089105},{"a":"Opus 5","b":"Grok 4.7 High","favors":"Grok 4.7 High","separates":false,"separatesRaw":false,"halfWidth":0.15730940062084947,"wins":7,"ties":11,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.48189941555761723,"winShareLow":0.3261140983971166,"winShareHigh":0.6407328996388155},{"a":"Opus 5","b":"Pareto 26.9","favors":"Opus 5","separates":false,"separatesRaw":false,"halfWidth":0.17019827853786312,"wins":10,"ties":6,"losses":8,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.5319115557709893,"winShareLow":0.36138763688509234,"winShareHigh":0.7017841939608186},{"a":"Opus 5","b":"Haiku 5.5 max","favors":"Opus 5","separates":false,"separatesRaw":false,"halfWidth":0.15715242924874867,"wins":9,"ties":9,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5916154256324991,"winShareLow":0.43463737754736365,"winShareHigh":0.748942236044861},{"a":"Opus 5","b":"GPT 6 Sol medium","favors":"Opus 5","separates":false,"separatesRaw":false,"halfWidth":0.15841443635027974,"wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6173190518682884,"winShareLow":0.45610162403971855,"winShareHigh":0.772930496740278},{"a":"Opus 5","b":"GPT 6 Luna max","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.14818578267900284,"wins":12,"ties":8,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6929228525407115,"winShareLow":0.540397180483871,"winShareHigh":0.8367687458418767},{"a":"Opus 5","b":"DeepSeek V4.1 Flash","favors":"Opus 5","separates":false,"separatesRaw":false,"halfWidth":0.16625669255769437,"wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.6304295338490563,"winShareLow":0.4596872318716102,"winShareHigh":0.792200616986999},{"a":"Opus 5","b":"Haiku 5.5 low+guidance","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.14048436250039242,"wins":16,"ties":6,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7368640748221312,"winShareLow":0.5887378135489048,"winShareHigh":0.8697065385496896},{"a":"Opus 5","b":"Haiku 5.5 low","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.11130426132597582,"wins":16,"ties":7,"losses":1,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.8127064392084296,"winShareLow":0.6919844541222857,"winShareHigh":0.9145929767742373},{"a":"Opus 5","b":"Opus 4.8","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.11437251370745172,"wins":12,"ties":11,"losses":1,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.759963615462524,"winShareLow":0.6386024781593498,"winShareHigh":0.8673475055742532},{"a":"Opus 5","b":"Muse control","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.1281366081458135,"wins":15,"ties":7,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.7850539105921593,"winShareLow":0.6471699133916273,"winShareHigh":0.9034431296832544},{"a":"Opus 5","b":"GLM 5.3 Flash","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.13592351291641103,"wins":18,"ties":3,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":20,"readCountsPrompts":true,"winShare":0.8185198626081593,"winShareLow":0.6691971726736494,"winShareHigh":0.9410441985064715},{"a":"Opus 5","b":"GPT 6 Luna low","favors":"Opus 5","separates":false,"separatesRaw":true,"halfWidth":0.13443484936247652,"wins":18,"ties":3,"losses":2,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.8213487351120752,"winShareLow":0.6766458247756315,"winShareHigh":0.9455155235005845},{"a":"Grok 4.7 High","b":"Pareto 26.9","favors":"Grok 4.7 High","separates":false,"separatesRaw":false,"halfWidth":0.13960697363198768,"wins":6,"ties":11,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5161369113896702,"winShareLow":0.37428079232793604,"winShareHigh":0.6534947395919114},{"a":"Grok 4.7 High","b":"Haiku 5.5 max","favors":"Grok 4.7 High","separates":false,"separatesRaw":false,"halfWidth":0.16537860489365497,"wins":9,"ties":8,"losses":6,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5532987285506631,"winShareLow":0.3857064905180043,"winShareHigh":0.7164637003053143},{"a":"Grok 4.7 High","b":"GPT 6 Sol medium","favors":"Grok 4.7 High","separates":false,"separatesRaw":false,"halfWidth":0.17153564870901905,"wins":12,"ties":5,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5615531168820175,"winShareLow":0.38952845050630414,"winShareHigh":0.7325997479243422},{"a":"Grok 4.7 High","b":"GPT 6 Luna max","favors":"Grok 4.7 High","separates":false,"separatesRaw":false,"halfWidth":0.16156460830303793,"wins":14,"ties":4,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.654495936619397,"winShareLow":0.4883979500157457,"winShareHigh":0.8115271666218216},{"a":"Grok 4.7 High","b":"DeepSeek V4.1 Flash","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.1669546143471088,"wins":14,"ties":4,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6826762577817181,"winShareLow":0.5075022144284587,"winShareHigh":0.8414114431226762},{"a":"Grok 4.7 High","b":"Haiku 5.5 low+guidance","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.13318455550016578,"wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7539044890768186,"winShareLow":0.6145868044872685,"winShareHigh":0.8809559154876001},{"a":"Grok 4.7 High","b":"Haiku 5.5 low","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.13597291614181317,"wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7439232550887939,"winShareLow":0.5980707617775819,"winShareHigh":0.8700165940612082},{"a":"Grok 4.7 High","b":"Opus 4.8","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.15642109631529894,"wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6859923770868838,"winShareLow":0.5236240863738898,"winShareHigh":0.8364662790044877},{"a":"Grok 4.7 High","b":"Muse control","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.1131297657205626,"wins":17,"ties":6,"losses":1,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.8176214555677671,"winShareLow":0.6970753800956091,"winShareHigh":0.9233349115367343},{"a":"Grok 4.7 High","b":"GLM 5.3 Flash","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.13036033404179698,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7933511501682499,"winShareLow":0.6541771937558358,"winShareHigh":0.9148978618394298},{"a":"Grok 4.7 High","b":"GPT 6 Luna low","favors":"Grok 4.7 High","separates":false,"separatesRaw":true,"halfWidth":0.14664665774373165,"wins":17,"ties":3,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.8046763450175144,"winShareLow":0.6475386418769411,"winShareHigh":0.9408319573644044},{"a":"Pareto 26.9","b":"Haiku 5.5 max","favors":"Haiku 5.5 max","separates":false,"separatesRaw":false,"halfWidth":0.17274074113063398,"wins":8,"ties":6,"losses":9,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.484220113176768,"winShareLow":0.3107116491520241,"winShareHigh":0.656193131413292},{"a":"Pareto 26.9","b":"GPT 6 Sol medium","favors":"Pareto 26.9","separates":false,"separatesRaw":false,"halfWidth":0.14848812365053532,"wins":7,"ties":11,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5417955282150232,"winShareLow":0.392312951376238,"winShareHigh":0.6892891986773086},{"a":"Pareto 26.9","b":"GPT 6 Luna max","favors":"Pareto 26.9","separates":false,"separatesRaw":false,"halfWidth":0.15871951874457318,"wins":9,"ties":7,"losses":8,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5504227505015219,"winShareLow":0.38910662334095936,"winShareHigh":0.7065456608301057},{"a":"Pareto 26.9","b":"DeepSeek V4.1 Flash","favors":"Pareto 26.9","separates":false,"separatesRaw":false,"halfWidth":0.1654143639801411,"wins":12,"ties":5,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.594549240769962,"winShareLow":0.4260744067808969,"winShareHigh":0.7569031347411791},{"a":"Pareto 26.9","b":"Haiku 5.5 low+guidance","favors":"Pareto 26.9","separates":false,"separatesRaw":true,"halfWidth":0.15031531722222502,"wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.713638137393427,"winShareLow":0.5567544798176556,"winShareHigh":0.8573851142621056},{"a":"Pareto 26.9","b":"Haiku 5.5 low","favors":"Pareto 26.9","separates":false,"separatesRaw":false,"halfWidth":0.14862609038937152,"wins":11,"ties":9,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6615225016182864,"winShareLow":0.5084793576756086,"winShareHigh":0.8057315384543516},{"a":"Pareto 26.9","b":"Opus 4.8","favors":"Pareto 26.9","separates":false,"separatesRaw":false,"halfWidth":0.16948374817232958,"wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.60510977688957,"winShareLow":0.4328023297349618,"winShareHigh":0.771769826079621},{"a":"Pareto 26.9","b":"Muse control","favors":"Pareto 26.9","separates":false,"separatesRaw":true,"halfWidth":0.1199106722228328,"wins":19,"ties":3,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.8178056590109878,"winShareLow":0.6864784437331208,"winShareHigh":0.9262997881787864},{"a":"Pareto 26.9","b":"GLM 5.3 Flash","favors":"Pareto 26.9","separates":false,"separatesRaw":true,"halfWidth":0.14791356599354594,"wins":16,"ties":4,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":19,"readCountsPrompts":true,"winShare":0.7553320412430192,"winShareLow":0.6005789761698215,"winShareHigh":0.8964061081569134},{"a":"Pareto 26.9","b":"GPT 6 Luna low","favors":"Pareto 26.9","separates":false,"separatesRaw":true,"halfWidth":0.08755201452707478,"wins":19,"ties":3,"losses":1,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.9129862102220345,"winShareLow":0.8085089996402155,"winShareHigh":0.9836130286943651},{"a":"Haiku 5.5 max","b":"GPT 6 Sol medium","favors":"Haiku 5.5 max","separates":false,"separatesRaw":false,"halfWidth":0.16471152543945006,"wins":8,"ties":8,"losses":7,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.5410071151138315,"winShareLow":0.37462396560311473,"winShareHigh":0.7040470164820148},{"a":"Haiku 5.5 max","b":"GPT 6 Luna max","favors":"Haiku 5.5 max","separates":false,"separatesRaw":false,"halfWidth":0.14519005459979073,"wins":10,"ties":9,"losses":4,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6454707336652692,"winShareLow":0.4947632976210258,"winShareHigh":0.7851434068206072},{"a":"Haiku 5.5 max","b":"DeepSeek V4.1 Flash","favors":"Haiku 5.5 max","separates":false,"separatesRaw":false,"halfWidth":0.1616927824771942,"wins":12,"ties":6,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6313943123428252,"winShareLow":0.4667777807649083,"winShareHigh":0.7901633457192967},{"a":"Haiku 5.5 max","b":"Haiku 5.5 low+guidance","favors":"Haiku 5.5 max","separates":false,"separatesRaw":false,"halfWidth":0.17845810269781348,"wins":13,"ties":3,"losses":7,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6263517314084794,"winShareLow":0.4417571314580975,"winShareHigh":0.7986733368537244},{"a":"Haiku 5.5 max","b":"Haiku 5.5 low","favors":"Haiku 5.5 max","separates":false,"separatesRaw":true,"halfWidth":0.15769878106729468,"wins":12,"ties":6,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6934487787645274,"winShareLow":0.529337487891921,"winShareHigh":0.8447350500265104},{"a":"Haiku 5.5 max","b":"Opus 4.8","favors":"Haiku 5.5 max","separates":false,"separatesRaw":true,"halfWidth":0.15926651910444778,"wins":15,"ties":4,"losses":4,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.713673236487307,"winShareLow":0.5491137002351106,"winShareHigh":0.8676467384440062},{"a":"Haiku 5.5 max","b":"Muse control","favors":"Haiku 5.5 max","separates":false,"separatesRaw":true,"halfWidth":0.16422434611049191,"wins":15,"ties":3,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7288663655514166,"winShareLow":0.5549186034295196,"winShareHigh":0.8833672956505034},{"a":"Haiku 5.5 max","b":"GLM 5.3 Flash","favors":"Haiku 5.5 max","separates":false,"separatesRaw":true,"halfWidth":0.16722459513606885,"wins":15,"ties":3,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7080407667371437,"winShareLow":0.5336720539944979,"winShareHigh":0.8681212442666356},{"a":"Haiku 5.5 max","b":"GPT 6 Luna low","favors":"Haiku 5.5 max","separates":false,"separatesRaw":true,"halfWidth":0.14368652471852122,"wins":16,"ties":4,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7801574182526455,"winShareLow":0.6267554382792035,"winShareHigh":0.914128487716246},{"a":"GPT 6 Sol medium","b":"GPT 6 Luna max","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.13507765863893323,"wins":9,"ties":12,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6072794940119097,"winShareLow":0.4695871853428265,"winShareHigh":0.739742502620693},{"a":"GPT 6 Sol medium","b":"DeepSeek V4.1 Flash","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.16320281710332868,"wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5991748186346544,"winShareLow":0.4327737415334787,"winShareHigh":0.759179375740136},{"a":"GPT 6 Sol medium","b":"Haiku 5.5 low+guidance","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.11844790119860571,"wins":9,"ties":13,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7078753180069001,"winShareLow":0.5825512675024919,"winShareHigh":0.8194470698997033},{"a":"GPT 6 Sol medium","b":"Haiku 5.5 low","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.13364148845931095,"wins":12,"ties":10,"losses":2,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7199751228924388,"winShareLow":0.5788042843851001,"winShareHigh":0.846087261303722},{"a":"GPT 6 Sol medium","b":"Opus 4.8","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":false,"halfWidth":0.1489901186841548,"wins":13,"ties":8,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6600290872714248,"winShareLow":0.5059280049480407,"winShareHigh":0.8039082423163503},{"a":"GPT 6 Sol medium","b":"Muse control","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.134524962453135,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7643564235610407,"winShareLow":0.6207815218849465,"winShareHigh":0.8898314467912165},{"a":"GPT 6 Sol medium","b":"GLM 5.3 Flash","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.13772572973521213,"wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7908496232821852,"winShareLow":0.6430657426002617,"winShareHigh":0.918517202070686},{"a":"GPT 6 Sol medium","b":"GPT 6 Luna low","favors":"GPT 6 Sol medium","separates":false,"separatesRaw":true,"halfWidth":0.0967505266374401,"wins":18,"ties":4,"losses":1,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.8898535609137896,"winShareLow":0.7799927467119303,"winShareHigh":0.9734937999868105},{"a":"GPT 6 Luna max","b":"DeepSeek V4.1 Flash","favors":"GPT 6 Luna max","separates":false,"separatesRaw":false,"halfWidth":0.15734285500337836,"wins":9,"ties":9,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.57398470477488,"winShareLow":0.41158405309649615,"winShareHigh":0.7262697631032529},{"a":"GPT 6 Luna max","b":"Haiku 5.5 low+guidance","favors":"GPT 6 Luna max","separates":false,"separatesRaw":false,"halfWidth":0.15192018846201197,"wins":11,"ties":8,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6196271848755286,"winShareLow":0.46481085641403636,"winShareHigh":0.7686512333380603},{"a":"GPT 6 Luna max","b":"Haiku 5.5 low","favors":"GPT 6 Luna max","separates":false,"separatesRaw":false,"halfWidth":0.1453805957464421,"wins":8,"ties":11,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6168244758052631,"winShareLow":0.46666567649396645,"winShareHigh":0.7574268679868507},{"a":"GPT 6 Luna max","b":"Opus 4.8","favors":"GPT 6 Luna max","separates":false,"separatesRaw":false,"halfWidth":0.17519504737121597,"wins":11,"ties":4,"losses":9,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5569649690888819,"winShareLow":0.37832626332256175,"winShareHigh":0.7287163580649937},{"a":"GPT 6 Luna max","b":"Muse control","favors":"GPT 6 Luna max","separates":false,"separatesRaw":true,"halfWidth":0.1546412241957938,"wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6701852855131163,"winShareLow":0.5099847939417563,"winShareHigh":0.8192672423333439},{"a":"GPT 6 Luna max","b":"GLM 5.3 Flash","favors":"GPT 6 Luna max","separates":false,"separatesRaw":true,"halfWidth":0.15087559029206787,"wins":17,"ties":3,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7539871348495835,"winShareLow":0.5946436559517367,"winShareHigh":0.8963948365358725},{"a":"GPT 6 Luna max","b":"GPT 6 Luna low","favors":"GPT 6 Luna max","separates":false,"separatesRaw":true,"halfWidth":0.11548303806291421,"wins":19,"ties":2,"losses":2,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.8752026661083405,"winShareLow":0.7429062599250231,"winShareHigh":0.9738723360508516},{"a":"DeepSeek V4.1 Flash","b":"Haiku 5.5 low+guidance","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":false,"halfWidth":0.16531075997722547,"wins":9,"ties":8,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5176985676747256,"winShareLow":0.3526909960082421,"winShareHigh":0.683312515962693},{"a":"DeepSeek V4.1 Flash","b":"Haiku 5.5 low","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":false,"halfWidth":0.15443179012286748,"wins":8,"ties":10,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5608257470343166,"winShareLow":0.4073629196700514,"winShareHigh":0.7162264999157864},{"a":"DeepSeek V4.1 Flash","b":"Opus 4.8","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":false,"halfWidth":0.16233799294727078,"wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.6171955711440454,"winShareLow":0.44937169400455906,"winShareHigh":0.7740476798991006},{"a":"DeepSeek V4.1 Flash","b":"Muse control","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":false,"halfWidth":0.15840007649820212,"wins":13,"ties":6,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.6526102081744182,"winShareLow":0.48782189865265285,"winShareHigh":0.8046220516490571},{"a":"DeepSeek V4.1 Flash","b":"GLM 5.3 Flash","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":false,"halfWidth":0.15641270935354967,"wins":14,"ties":5,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":19,"readCountsPrompts":true,"winShare":0.6645159560405648,"winShareLow":0.5027946886319228,"winShareHigh":0.8156201073390221},{"a":"DeepSeek V4.1 Flash","b":"GPT 6 Luna low","favors":"DeepSeek V4.1 Flash","separates":false,"separatesRaw":true,"halfWidth":0.13746940540569214,"wins":17,"ties":3,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.7860748610066773,"winShareLow":0.6387800047989308,"winShareHigh":0.9137188156103151},{"a":"Haiku 5.5 low+guidance","b":"Haiku 5.5 low","favors":"Haiku 5.5 low+guidance","separates":false,"separatesRaw":false,"halfWidth":0.14906502729671534,"wins":7,"ties":10,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.50631664358702,"winShareLow":0.3568096986013545,"winShareHigh":0.6549397531947851},{"a":"Haiku 5.5 low+guidance","b":"Opus 4.8","favors":"Haiku 5.5 low+guidance","separates":false,"separatesRaw":false,"halfWidth":0.1722256697693347,"wins":8,"ties":6,"losses":10,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5189835544673008,"winShareLow":0.3450235559327251,"winShareHigh":0.6894748954713945},{"a":"Haiku 5.5 low+guidance","b":"Muse control","favors":"Haiku 5.5 low+guidance","separates":false,"separatesRaw":false,"halfWidth":0.16998450152250685,"wins":10,"ties":7,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.5349702421045538,"winShareLow":0.36233150254701435,"winShareHigh":0.7023005055920281},{"a":"Haiku 5.5 low+guidance","b":"GLM 5.3 Flash","favors":"Haiku 5.5 low+guidance","separates":false,"separatesRaw":true,"halfWidth":0.15264054153258244,"wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6758455057941974,"winShareLow":0.5159784414336546,"winShareHigh":0.8212595244988194},{"a":"Haiku 5.5 low+guidance","b":"GPT 6 Luna low","favors":"Haiku 5.5 low+guidance","separates":false,"separatesRaw":true,"halfWidth":0.13206306161577597,"wins":15,"ties":5,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.7963607916998737,"winShareLow":0.6543043709889163,"winShareHigh":0.9184304942204682},{"a":"Haiku 5.5 low","b":"Opus 4.8","favors":"Haiku 5.5 low","separates":false,"separatesRaw":false,"halfWidth":0.16376207504535414,"wins":10,"ties":8,"losses":6,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.569176774872928,"winShareLow":0.4019896564020858,"winShareHigh":0.7295138064927941},{"a":"Haiku 5.5 low","b":"Muse control","favors":"Haiku 5.5 low","separates":false,"separatesRaw":false,"halfWidth":0.15498230563304463,"wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6262070077851076,"winShareLow":0.46811856420599535,"winShareHigh":0.7780831754720846},{"a":"Haiku 5.5 low","b":"GLM 5.3 Flash","favors":"Haiku 5.5 low","separates":false,"separatesRaw":false,"halfWidth":0.15130756400757228,"wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6653984602919764,"winShareLow":0.5103817796667536,"winShareHigh":0.8129969076818981},{"a":"Haiku 5.5 low","b":"GPT 6 Luna low","favors":"Haiku 5.5 low","separates":false,"separatesRaw":true,"halfWidth":0.13594000732898293,"wins":14,"ties":6,"losses":3,"undecided":1,"sharedTasks":24,"differingPrompts":0,"readCountsPrompts":true,"winShare":0.777649032436892,"winShareLow":0.6321921926603102,"winShareHigh":0.9040722073182761},{"a":"Opus 4.8","b":"Muse control","favors":"Opus 4.8","separates":false,"separatesRaw":false,"halfWidth":0.16258306377903375,"wins":11,"ties":6,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":10,"readCountsPrompts":true,"winShare":0.5999056876384453,"winShareLow":0.43397181487069203,"winShareHigh":0.7591379424287595},{"a":"Opus 4.8","b":"GLM 5.3 Flash","favors":"Opus 4.8","separates":false,"separatesRaw":false,"halfWidth":0.17367315729719685,"wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"differingPrompts":20,"readCountsPrompts":true,"winShare":0.6080909069137931,"winShareLow":0.4337229163791404,"winShareHigh":0.7810692309735341},{"a":"Opus 4.8","b":"GPT 6 Luna low","favors":"Opus 4.8","separates":false,"separatesRaw":true,"halfWidth":0.16715112504874918,"wins":14,"ties":4,"losses":5,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6908186280430052,"winShareLow":0.5161607887234023,"winShareHigh":0.8504630388209007},{"a":"Muse control","b":"GLM 5.3 Flash","favors":"Muse control","separates":false,"separatesRaw":false,"halfWidth":0.13800597151346666,"wins":8,"ties":13,"losses":3,"undecided":0,"sharedTasks":24,"differingPrompts":19,"readCountsPrompts":true,"winShare":0.6142818752967427,"winShareLow":0.4728718946224967,"winShareHigh":0.74888383764943},{"a":"Muse control","b":"GPT 6 Luna low","favors":"Muse control","separates":false,"separatesRaw":false,"halfWidth":0.16061847746180707,"wins":12,"ties":7,"losses":4,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6554637100616906,"winShareLow":0.49011858285110066,"winShareHigh":0.8113555377747148},{"a":"GLM 5.3 Flash","b":"GPT 6 Luna low","favors":"GLM 5.3 Flash","separates":false,"separatesRaw":true,"halfWidth":0.1545180520258546,"wins":12,"ties":7,"losses":4,"undecided":1,"sharedTasks":24,"differingPrompts":23,"readCountsPrompts":true,"winShare":0.6854458320118954,"winShareLow":0.5260833508703979,"winShareHigh":0.8351194549221072}],"differingPrompts":{"matchups":1484,"unknownMatchups":0,"total":2520},"selectedArms":["Haiku 5.5 low+guidance","Grok 4.7 High","GPT 6 Sol medium","GPT 6.1 Sol medium","Pareto 26.9","SWE-2 Max","DeepSeek V4.1 Flash","Muse control","Opus 5","Opus 4.8","GLM 5.3 Flash","Haiku 5.5 low","Haiku 5.5 max","GPT 6 Luna max","GPT 6 Luna low"],"coreTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"extensionTaskIds":[],"tasks":24},"growth":[],"matchups":2520,"pairs":[{"a":"SWE-2 Max","b":"GPT 6.1 Sol medium","wins":10,"ties":8,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5656843862449151,"low":0.4019639963346101,"high":0.7254653085687588},"calls":null},{"a":"SWE-2 Max","b":"Opus 5","wins":8,"ties":10,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5422996318049438,"low":0.3849836495361453,"high":0.6980352694921805},"calls":null},{"a":"SWE-2 Max","b":"Grok 4.7 High","wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5876309742756701,"low":0.4279974923660429,"high":0.7464781738715107},"calls":null},{"a":"SWE-2 Max","b":"Pareto 26.9","wins":9,"ties":8,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5575420121330054,"low":0.3940792417467808,"high":0.7185837691268152},"calls":null},{"a":"SWE-2 Max","b":"Haiku 5.5 max","wins":7,"ties":13,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5781329140604131,"low":0.4341114178074267,"high":0.7191821967085552},"calls":null},{"a":"SWE-2 Max","b":"GPT 6 Sol medium","wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.637402039492738,"low":0.47287896562501,"high":0.792943111530155},"calls":null},{"a":"SWE-2 Max","b":"GPT 6 Luna max","wins":13,"ties":8,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7090278243709194,"low":0.561172029930469,"high":0.8430203183082703},"calls":null},{"a":"SWE-2 Max","b":"DeepSeek V4.1 Flash","wins":13,"ties":6,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6718198375412999,"low":0.5167319359563767,"high":0.8163489188000287},"calls":null},{"a":"SWE-2 Max","b":"Haiku 5.5 low+guidance","wins":15,"ties":5,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7058601092058145,"low":0.5389422098698362,"high":0.8583318761575897},"calls":null},{"a":"SWE-2 Max","b":"Haiku 5.5 low","wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7029172877346469,"low":0.547873601602169,"high":0.8488389589229145},"calls":null},{"a":"SWE-2 Max","b":"Opus 4.8","wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.758038213384255,"low":0.6085261388836718,"high":0.892724296711827},"calls":null},{"a":"SWE-2 Max","b":"Muse control","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.756430722474183,"low":0.608541506705985,"high":0.8929786758169675},"calls":null},{"a":"SWE-2 Max","b":"GLM 5.3 Flash","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":19,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7774662602210435,"low":0.6314590482329512,"high":0.9063602930639756},"calls":null},{"a":"SWE-2 Max","b":"GPT 6 Luna low","wins":17,"ties":4,"losses":2,"undecided":1,"sharedTasks":24,"separates":false,"favors":"SWE-2 Max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8289187552645566,"low":0.6885296404235456,"high":0.9470925926115301},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Opus 5","wins":8,"ties":9,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.4962245700363146,"low":0.3427146454023715,"high":0.6516398863448096},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Grok 4.7 High","wins":10,"ties":5,"losses":9,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5004657553798606,"low":0.33266755033791146,"high":0.6714002698415665},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Pareto 26.9","wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6066165121883761,"low":0.4352076235098219,"high":0.7701368733823454},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 max","wins":9,"ties":10,"losses":4,"undecided":1,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5891646259817218,"low":0.43221753127236834,"high":0.7415126412392687},"calls":null},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Sol medium","wins":9,"ties":10,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6253675048444628,"low":0.4763685386903894,"high":0.7627681699841014},"calls":null},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Luna max","wins":13,"ties":7,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.685800569304063,"low":0.5376484778226187,"high":0.8213520736234033},"calls":null},{"a":"GPT 6.1 Sol medium","b":"DeepSeek V4.1 Flash","wins":12,"ties":9,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6898567507079987,"low":0.5446576168517361,"high":0.8245792245121305},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 low+guidance","wins":13,"ties":9,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7255310796453968,"low":0.5861544815387102,"high":0.8508371457444722},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Haiku 5.5 low","wins":13,"ties":10,"losses":1,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7825388822521558,"low":0.6596802426857694,"high":0.8890602069519847},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Opus 4.8","wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7740788341660142,"low":0.6346250824880001,"high":0.8927184542651799},"calls":null},{"a":"GPT 6.1 Sol medium","b":"Muse control","wins":17,"ties":5,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7821356115440485,"low":0.6367119953169484,"high":0.9100545857953021},"calls":null},{"a":"GPT 6.1 Sol medium","b":"GLM 5.3 Flash","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7515990864824446,"low":0.6008851395959982,"high":0.8886501536747743},"calls":null},{"a":"GPT 6.1 Sol medium","b":"GPT 6 Luna low","wins":17,"ties":5,"losses":1,"undecided":1,"sharedTasks":24,"separates":false,"favors":"GPT 6.1 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8151214658371062,"low":0.6846830912060482,"high":0.9301040089089105},"calls":null},{"a":"Opus 5","b":"Grok 4.7 High","wins":7,"ties":11,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.48189941555761723,"low":0.3261140983971166,"high":0.6407328996388155},"calls":null},{"a":"Opus 5","b":"Pareto 26.9","wins":10,"ties":6,"losses":8,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5319115557709893,"low":0.36138763688509234,"high":0.7017841939608186},"calls":null},{"a":"Opus 5","b":"Haiku 5.5 max","wins":9,"ties":9,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5916154256324991,"low":0.43463737754736365,"high":0.748942236044861},"calls":null},{"a":"Opus 5","b":"GPT 6 Sol medium","wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6173190518682884,"low":0.45610162403971855,"high":0.772930496740278},"calls":null},{"a":"Opus 5","b":"GPT 6 Luna max","wins":12,"ties":8,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6929228525407115,"low":0.540397180483871,"high":0.8367687458418767},"calls":null},{"a":"Opus 5","b":"DeepSeek V4.1 Flash","wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6304295338490563,"low":0.4596872318716102,"high":0.792200616986999},"calls":null},{"a":"Opus 5","b":"Haiku 5.5 low+guidance","wins":16,"ties":6,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7368640748221312,"low":0.5887378135489048,"high":0.8697065385496896},"calls":null},{"a":"Opus 5","b":"Haiku 5.5 low","wins":16,"ties":7,"losses":1,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8127064392084296,"low":0.6919844541222857,"high":0.9145929767742373},"calls":null},{"a":"Opus 5","b":"Opus 4.8","wins":12,"ties":11,"losses":1,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.759963615462524,"low":0.6386024781593498,"high":0.8673475055742532},"calls":null},{"a":"Opus 5","b":"Muse control","wins":15,"ties":7,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7850539105921593,"low":0.6471699133916273,"high":0.9034431296832544},"calls":null},{"a":"Opus 5","b":"GLM 5.3 Flash","wins":18,"ties":3,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":20,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8185198626081593,"low":0.6691971726736494,"high":0.9410441985064715},"calls":null},{"a":"Opus 5","b":"GPT 6 Luna low","wins":18,"ties":3,"losses":2,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Opus 5","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8213487351120752,"low":0.6766458247756315,"high":0.9455155235005845},"calls":null},{"a":"Grok 4.7 High","b":"Pareto 26.9","wins":6,"ties":11,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5161369113896702,"low":0.37428079232793604,"high":0.6534947395919114},"calls":null},{"a":"Grok 4.7 High","b":"Haiku 5.5 max","wins":9,"ties":8,"losses":6,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5532987285506631,"low":0.3857064905180043,"high":0.7164637003053143},"calls":null},{"a":"Grok 4.7 High","b":"GPT 6 Sol medium","wins":12,"ties":5,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5615531168820175,"low":0.38952845050630414,"high":0.7325997479243422},"calls":null},{"a":"Grok 4.7 High","b":"GPT 6 Luna max","wins":14,"ties":4,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.654495936619397,"low":0.4883979500157457,"high":0.8115271666218216},"calls":null},{"a":"Grok 4.7 High","b":"DeepSeek V4.1 Flash","wins":14,"ties":4,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6826762577817181,"low":0.5075022144284587,"high":0.8414114431226762},"calls":null},{"a":"Grok 4.7 High","b":"Haiku 5.5 low+guidance","wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7539044890768186,"low":0.6145868044872685,"high":0.8809559154876001},"calls":null},{"a":"Grok 4.7 High","b":"Haiku 5.5 low","wins":15,"ties":6,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7439232550887939,"low":0.5980707617775819,"high":0.8700165940612082},"calls":null},{"a":"Grok 4.7 High","b":"Opus 4.8","wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6859923770868838,"low":0.5236240863738898,"high":0.8364662790044877},"calls":null},{"a":"Grok 4.7 High","b":"Muse control","wins":17,"ties":6,"losses":1,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8176214555677671,"low":0.6970753800956091,"high":0.9233349115367343},"calls":null},{"a":"Grok 4.7 High","b":"GLM 5.3 Flash","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7933511501682499,"low":0.6541771937558358,"high":0.9148978618394298},"calls":null},{"a":"Grok 4.7 High","b":"GPT 6 Luna low","wins":17,"ties":3,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Grok 4.7 High","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8046763450175144,"low":0.6475386418769411,"high":0.9408319573644044},"calls":null},{"a":"Pareto 26.9","b":"Haiku 5.5 max","wins":8,"ties":6,"losses":9,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.484220113176768,"low":0.3107116491520241,"high":0.656193131413292},"calls":null},{"a":"Pareto 26.9","b":"GPT 6 Sol medium","wins":7,"ties":11,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5417955282150232,"low":0.392312951376238,"high":0.6892891986773086},"calls":null},{"a":"Pareto 26.9","b":"GPT 6 Luna max","wins":9,"ties":7,"losses":8,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5504227505015219,"low":0.38910662334095936,"high":0.7065456608301057},"calls":null},{"a":"Pareto 26.9","b":"DeepSeek V4.1 Flash","wins":12,"ties":5,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.594549240769962,"low":0.4260744067808969,"high":0.7569031347411791},"calls":null},{"a":"Pareto 26.9","b":"Haiku 5.5 low+guidance","wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.713638137393427,"low":0.5567544798176556,"high":0.8573851142621056},"calls":null},{"a":"Pareto 26.9","b":"Haiku 5.5 low","wins":11,"ties":9,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6615225016182864,"low":0.5084793576756086,"high":0.8057315384543516},"calls":null},{"a":"Pareto 26.9","b":"Opus 4.8","wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.60510977688957,"low":0.4328023297349618,"high":0.771769826079621},"calls":null},{"a":"Pareto 26.9","b":"Muse control","wins":19,"ties":3,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8178056590109878,"low":0.6864784437331208,"high":0.9262997881787864},"calls":null},{"a":"Pareto 26.9","b":"GLM 5.3 Flash","wins":16,"ties":4,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":19,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7553320412430192,"low":0.6005789761698215,"high":0.8964061081569134},"calls":null},{"a":"Pareto 26.9","b":"GPT 6 Luna low","wins":19,"ties":3,"losses":1,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Pareto 26.9","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.9129862102220345,"low":0.8085089996402155,"high":0.9836130286943651},"calls":null},{"a":"Haiku 5.5 max","b":"GPT 6 Sol medium","wins":8,"ties":8,"losses":7,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5410071151138315,"low":0.37462396560311473,"high":0.7040470164820148},"calls":null},{"a":"Haiku 5.5 max","b":"GPT 6 Luna max","wins":10,"ties":9,"losses":4,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6454707336652692,"low":0.4947632976210258,"high":0.7851434068206072},"calls":null},{"a":"Haiku 5.5 max","b":"DeepSeek V4.1 Flash","wins":12,"ties":6,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6313943123428252,"low":0.4667777807649083,"high":0.7901633457192967},"calls":null},{"a":"Haiku 5.5 max","b":"Haiku 5.5 low+guidance","wins":13,"ties":3,"losses":7,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6263517314084794,"low":0.4417571314580975,"high":0.7986733368537244},"calls":null},{"a":"Haiku 5.5 max","b":"Haiku 5.5 low","wins":12,"ties":6,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6934487787645274,"low":0.529337487891921,"high":0.8447350500265104},"calls":null},{"a":"Haiku 5.5 max","b":"Opus 4.8","wins":15,"ties":4,"losses":4,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.713673236487307,"low":0.5491137002351106,"high":0.8676467384440062},"calls":null},{"a":"Haiku 5.5 max","b":"Muse control","wins":15,"ties":3,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7288663655514166,"low":0.5549186034295196,"high":0.8833672956505034},"calls":null},{"a":"Haiku 5.5 max","b":"GLM 5.3 Flash","wins":15,"ties":3,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7080407667371437,"low":0.5336720539944979,"high":0.8681212442666356},"calls":null},{"a":"Haiku 5.5 max","b":"GPT 6 Luna low","wins":16,"ties":4,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7801574182526455,"low":0.6267554382792035,"high":0.914128487716246},"calls":null},{"a":"GPT 6 Sol medium","b":"GPT 6 Luna max","wins":9,"ties":12,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6072794940119097,"low":0.4695871853428265,"high":0.739742502620693},"calls":null},{"a":"GPT 6 Sol medium","b":"DeepSeek V4.1 Flash","wins":12,"ties":6,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5991748186346544,"low":0.4327737415334787,"high":0.759179375740136},"calls":null},{"a":"GPT 6 Sol medium","b":"Haiku 5.5 low+guidance","wins":9,"ties":13,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7078753180069001,"low":0.5825512675024919,"high":0.8194470698997033},"calls":null},{"a":"GPT 6 Sol medium","b":"Haiku 5.5 low","wins":12,"ties":10,"losses":2,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7199751228924388,"low":0.5788042843851001,"high":0.846087261303722},"calls":null},{"a":"GPT 6 Sol medium","b":"Opus 4.8","wins":13,"ties":8,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6600290872714248,"low":0.5059280049480407,"high":0.8039082423163503},"calls":null},{"a":"GPT 6 Sol medium","b":"Muse control","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7643564235610407,"low":0.6207815218849465,"high":0.8898314467912165},"calls":null},{"a":"GPT 6 Sol medium","b":"GLM 5.3 Flash","wins":16,"ties":5,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7908496232821852,"low":0.6430657426002617,"high":0.918517202070686},"calls":null},{"a":"GPT 6 Sol medium","b":"GPT 6 Luna low","wins":18,"ties":4,"losses":1,"undecided":1,"sharedTasks":24,"separates":false,"favors":"GPT 6 Sol medium","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8898535609137896,"low":0.7799927467119303,"high":0.9734937999868105},"calls":null},{"a":"GPT 6 Luna max","b":"DeepSeek V4.1 Flash","wins":9,"ties":9,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.57398470477488,"low":0.41158405309649615,"high":0.7262697631032529},"calls":null},{"a":"GPT 6 Luna max","b":"Haiku 5.5 low+guidance","wins":11,"ties":8,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6196271848755286,"low":0.46481085641403636,"high":0.7686512333380603},"calls":null},{"a":"GPT 6 Luna max","b":"Haiku 5.5 low","wins":8,"ties":11,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6168244758052631,"low":0.46666567649396645,"high":0.7574268679868507},"calls":null},{"a":"GPT 6 Luna max","b":"Opus 4.8","wins":11,"ties":4,"losses":9,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5569649690888819,"low":0.37832626332256175,"high":0.7287163580649937},"calls":null},{"a":"GPT 6 Luna max","b":"Muse control","wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6701852855131163,"low":0.5099847939417563,"high":0.8192672423333439},"calls":null},{"a":"GPT 6 Luna max","b":"GLM 5.3 Flash","wins":17,"ties":3,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7539871348495835,"low":0.5946436559517367,"high":0.8963948365358725},"calls":null},{"a":"GPT 6 Luna max","b":"GPT 6 Luna low","wins":19,"ties":2,"losses":2,"undecided":1,"sharedTasks":24,"separates":false,"favors":"GPT 6 Luna max","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.8752026661083405,"low":0.7429062599250231,"high":0.9738723360508516},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"Haiku 5.5 low+guidance","wins":9,"ties":8,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5176985676747256,"low":0.3526909960082421,"high":0.683312515962693},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"Haiku 5.5 low","wins":8,"ties":10,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5608257470343166,"low":0.4073629196700514,"high":0.7162264999157864},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"Opus 4.8","wins":11,"ties":7,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6171955711440454,"low":0.44937169400455906,"high":0.7740476798991006},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"Muse control","wins":13,"ties":6,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6526102081744182,"low":0.48782189865265285,"high":0.8046220516490571},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"GLM 5.3 Flash","wins":14,"ties":5,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":19,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6645159560405648,"low":0.5027946886319228,"high":0.8156201073390221},"calls":null},{"a":"DeepSeek V4.1 Flash","b":"GPT 6 Luna low","wins":17,"ties":3,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"DeepSeek V4.1 Flash","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7860748610066773,"low":0.6387800047989308,"high":0.9137188156103151},"calls":null},{"a":"Haiku 5.5 low+guidance","b":"Haiku 5.5 low","wins":7,"ties":10,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low+guidance","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.50631664358702,"low":0.3568096986013545,"high":0.6549397531947851},"calls":null},{"a":"Haiku 5.5 low+guidance","b":"Opus 4.8","wins":8,"ties":6,"losses":10,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low+guidance","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5189835544673008,"low":0.3450235559327251,"high":0.6894748954713945},"calls":null},{"a":"Haiku 5.5 low+guidance","b":"Muse control","wins":10,"ties":7,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low+guidance","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5349702421045538,"low":0.36233150254701435,"high":0.7023005055920281},"calls":null},{"a":"Haiku 5.5 low+guidance","b":"GLM 5.3 Flash","wins":14,"ties":6,"losses":4,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low+guidance","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6758455057941974,"low":0.5159784414336546,"high":0.8212595244988194},"calls":null},{"a":"Haiku 5.5 low+guidance","b":"GPT 6 Luna low","wins":15,"ties":5,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low+guidance","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.7963607916998737,"low":0.6543043709889163,"high":0.9184304942204682},"calls":null},{"a":"Haiku 5.5 low","b":"Opus 4.8","wins":10,"ties":8,"losses":6,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.569176774872928,"low":0.4019896564020858,"high":0.7295138064927941},"calls":null},{"a":"Haiku 5.5 low","b":"Muse control","wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6262070077851076,"low":0.46811856420599535,"high":0.7780831754720846},"calls":null},{"a":"Haiku 5.5 low","b":"GLM 5.3 Flash","wins":12,"ties":7,"losses":5,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6653984602919764,"low":0.5103817796667536,"high":0.8129969076818981},"calls":null},{"a":"Haiku 5.5 low","b":"GPT 6 Luna low","wins":14,"ties":6,"losses":3,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Haiku 5.5 low","read":null,"differingPrompts":0,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.777649032436892,"low":0.6321921926603102,"high":0.9040722073182761},"calls":null},{"a":"Opus 4.8","b":"Muse control","wins":11,"ties":6,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 4.8","read":null,"differingPrompts":10,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.5999056876384453,"low":0.43397181487069203,"high":0.7591379424287595},"calls":null},{"a":"Opus 4.8","b":"GLM 5.3 Flash","wins":13,"ties":4,"losses":7,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Opus 4.8","read":null,"differingPrompts":20,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6080909069137931,"low":0.4337229163791404,"high":0.7810692309735341},"calls":null},{"a":"Opus 4.8","b":"GPT 6 Luna low","wins":14,"ties":4,"losses":5,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Opus 4.8","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6908186280430052,"low":0.5161607887234023,"high":0.8504630388209007},"calls":null},{"a":"Muse control","b":"GLM 5.3 Flash","wins":8,"ties":13,"losses":3,"undecided":0,"sharedTasks":24,"separates":false,"favors":"Muse control","read":null,"differingPrompts":19,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6142818752967427,"low":0.4728718946224967,"high":0.74888383764943},"calls":null},{"a":"Muse control","b":"GPT 6 Luna low","wins":12,"ties":7,"losses":4,"undecided":1,"sharedTasks":24,"separates":false,"favors":"Muse control","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6554637100616906,"low":0.49011858285110066,"high":0.8113555377747148},"calls":null},{"a":"GLM 5.3 Flash","b":"GPT 6 Luna low","wins":12,"ties":7,"losses":4,"undecided":1,"sharedTasks":24,"separates":false,"favors":"GLM 5.3 Flash","read":null,"differingPrompts":23,"sharedObservedTaskIds":["stet-15439c21","stet-232b50ba","stet-2450ca2d","stet-3169aefa","stet-43493c52","stet-5276aa3f","stet-66762b4c","stet-6f84e978","stet-89dfbc27","stet-b28f4fe7","stet-commit-2826765e","stet-commit-30506f8e","stet-commit-342d0ac0","stet-commit-5d766dde","stet-commit-5e075641","stet-commit-60a0e6c2","stet-commit-87814583","stet-commit-a8716b88","stet-commit-bbbbae09","stet-commit-d2ab0c25","stet-commit-e41c2e2d","stet-commit-e928166f","stet-commit-f0caded9","stet-commit-f8ae1177"],"winShare":{"share":0.6854458320118954,"low":0.5260833508703979,"high":0.8351194549221072},"calls":null}],"judgeNoise":0.024733877696033694,"resamples":10000,"paretoRecorded":true,"lead":{"label":"SWE-2 Max","next":"GPT 6.1 Sol medium","relation":"directional","nextSeparates":false,"clearOf":[]},"receipt":{"answer":"inconclusive","recommendation":"inspect","confidence":"low"}},"source":{"boardId":"bmk_d4ba310fdf50db4ccb2092e3","reportSha256":"0bbc1f6210cf4ed08f9a425024a6e7e45e25a003fc5fe3585536c3c694d96f46","headDigest":"sha256:d34123b5df1396ebc24f274af135704f492fee23dd2f05ba6770e7a6d0970661","acceptedAt":"2026-10-21T18:23:38.660Z","artifacts":{"projection":"/leaderboard/benchmark.json?report=0bbc1f6210cf4ed08f9a425024a6e7e45e25a003fc5fe3585536c3c694d96f46","routing":"/leaderboard/stet-routing.md?report=0bbc1f6210cf4ed08f9a425024a6e7e45e25a003fc5fe3585536c3c694d96f46"}},"checkedAt":"2026-10-22T16:36:21.460Z","unavailable":false}