STET

flux-pr-4568

Zod (TypeScript) · W2 · GPT-5.4

pass_with_warn

Tests passed. 3/3 commands passed. Strength: weak.

69.2% run pass rate
Tier 1
primary equivalencepassednon equivalentdecision conflictfailneeds generated testsweak signal riskcommand source drift
pnpm build
gold passagent pass
find . -name vitest.config.ts -exec sed -i 's/test: {/test: { testTimeout: 30000,/' {} +
gold passagent pass
npx vitest run packages/zod/src/v4/mini/tests/object.test.ts -t "z\.object\(\)\.check\(\)"
gold passagent pass

Partial score: 3/3

Publishable: noWeak signal risk: yesCache: miss

Trajectory

unknown · partial order only

Canonical trajectory missing; showing coarse derived order only.

patch written
Patch captured
#1

Stet captured agent.patch for this trial.

validation
Tests passed
#2
equivalence
Equivalence judgment
#3

non_equivalent

code review
Code review judgment
#4

fail

decision
Final decision
#5

pass_with_warn

Quality

equivalence
non_equivalent
95% confidence
code review
fail · 35/100
2 findings
footprint
low (0.31)
behavioral
100.0%
cost
$1.08 · 1.7M

Equivalence Reasoning

behavioral

The patch only partially implements the intended type-inference fix. It updates `mini/schemas.ts` and function inference type aliases, but misses the `v4/classic/schemas.ts` `superRefine`/`pipe` generic corrections that are part of the input/output inference alignment. It also introduces `core.input/output` usages in `v4/core/function.ts` without adding the required `core` type import, so the change is incomplete and likely breaks type checking.

Code Review

correctness: 1/4introduced bug risk: 1/4edge case handling: 2/4maintainability idioms: 2/4

The patch is directionally correct for mini/core inference but likely does not compile due to a missing import and does not fully satisfy the intended change because classic schema inference adjustments are missing.

2 findings
Missing `core` type import after switching to `core.output/input`
major

The patch replaces `_zod` access with `core.output`/`core.input` in function inference types but does not add `import type * as core from "./core.js";`, so the `core` namespace is unresolved.

packages/zod/src/v4/core/function.ts:29
Classic schema inference updates were omitted
major

Intended inference fixes include classic `superRefine` and `pipe` signatures using `core.output<this>`, but the agent patch does not modify `packages/zod/src/v4/classic/schemas.ts`, leaving part of the type-inference bug unresolved.

packages/zod/src/v4/classic/schemas.ts:56