STET

flux-commit-a8580f2b

Zod (TypeScript) · W2 · GPT-5.1 Codex Mini

pass_with_warn

Tests passed. 2/2 commands passed. Strength: strong.

61.5% run pass rate
Tier 1
primary testspassednon equivalentfail
find . -name vitest.config.ts -exec sed -i 's/test: {/test: { testTimeout: 30000,/' {} +
gold passagent pass
yarn test -- --runInBand
gold passagent pass

Partial score: 2/2

Publishable: noCache: miss

Trajectory

unknown · partial order only

Canonical trajectory missing; showing coarse derived order only.

patch written
Patch captured
#1

Stet captured agent.patch for this trial.

validation
Tests passed
#2
equivalence
Equivalence judgment
#3

non_equivalent

code review
Code review judgment
#4

fail

decision
Final decision
#5

pass_with_warn

Quality

equivalence
non_equivalent
97% confidence
code review
fail
3 findings
footprint
high (1.00)
behavioral
100.0%
cost
$1.49 · 3.0M

Equivalence Reasoning

behavioral

The agent patch does not show the core implementation required by the task: no object-schema `.partial`/`.deepPartial` type+runtime support and no parser behavior update for explicit unknown-key errors. It mainly changes README TOC entries and adds many `node_modules/.bin` symlinks, which are unrelated to the intended functional change.

Code Review

correctness: 1/4introduced bug risk: 0/4edge case handling: 1/4maintainability idioms: 0/4

This patch likely does not satisfy the intended change: visible edits are mostly accidental dependency artifacts with minimal documentation touch-up, and there is no clear evidence of the required schema/parser/type implementation work.

3 findings
Patch content is largely unrelated to requested feature work
major

The diff excerpt shows mainly `node_modules/.bin` additions plus a README TOC edit, not the expected object-schema/type/parser updates for `partial`/`deepPartial` and explicit unknown-key errors.

app/README.md:29
Generated dependency binaries were committed
major

Adding many `node_modules/.bin/*` symlinks is repository noise and not source-of-truth code; it raises maintenance burden and obscures substantive changes.

app/node_modules/.bin/jest:1
README TOC update appears inconsistent with intended docs section
major

The TOC adds separate `.partial` and `.deepPartial` anchors (`#partial`, `#deeppartial`), which does not match the intended combined section naming and may create broken or inconsistent documentation navigation.

app/README.md:31