STET

flux-pr-4807

Zod (TypeScript) · W2 · GPT-5.3 Codex

pass_with_warn

Tests passed. 2/2 commands passed. Strength: strong.

69.2% run pass rate
Tier 1
primary testspasseddecision conflictnon equivalentfail
find . -name vitest.config.ts -exec sed -i 's/test: {/test: { testTimeout: 30000,/' {} +
gold passagent pass
pnpm test -- --maxWorkers 1 --maxConcurrency 1 --retry 2
gold passagent pass

Partial score: 2/2

Publishable: yesCache: miss

Trajectory

unknown · partial order only

Canonical trajectory missing; showing coarse derived order only.

patch written
Patch captured
#1

Stet captured agent.patch for this trial.

validation
Tests passed
#2
equivalence
Equivalence judgment
#3

non_equivalent

code review
Code review judgment
#4

fail

decision
Final decision
#5

pass_with_warn

Quality

equivalence
non_equivalent
89% confidence
code review
fail
6 findings
footprint
low (0.27)
behavioral
100.0%
cost
$5.99 · 2.3M

Equivalence Reasoning

behavioral

The patch hits part of the intent (untracked-file checks in hooks, `zod4/v4` bench import, version bump, and some `NEVER`/normalization updates), but it misses key required behavior. It does not add the new ecosystem community project in the expected ecosystem data list (it edits docs content instead), and its async doc anchor changes differ from the intended target anchors. It also does not align with the intended shared `NEVER` wiring (compat still keeps its own sentinel) and omits other release-wiring updates (e.g., bench dependency/version wiring and intended build-setting refresh).

Code Review

correctness: 1/4introduced bug risk: 1/4edge case handling: 2/4maintainability idioms: 2/4

The patch appears to pass tests but likely does not satisfy the intended change set: it implements only part of the requested updates and diverges in docs targets, ecosystem placement, build settings, and scope of runtime/tooling modifications.

6 findings
Async docs anchors were changed to likely wrong targets
major

The patch rewrites links to `/api#refinements` and `/api#transforms`, while intended updates use the specific transform anchor and keep refine references consistent. This risks broken navigation in docs.

packages/docs/content/basics.mdx:66
Ecosystem update applied to wrong content surface
major

Instead of adding the new API library entry in the ecosystem component list, the patch adds a general docs bullet in `ecosystem.mdx`, which does not satisfy the intended ecosystem resource change.

packages/docs/content/ecosystem.mdx:23
Resolution build config changed in unintended direction
major

The patch introduces `module` and `moduleResolution` `NodeNext` in `tsconfig.build.json` rather than applying the intended build-setting refresh around stricter checking (`skipLibCheck` change). This is a behavioral config divergence.

packages/resolution/tsconfig.build.json:5
Bench migration is incomplete
major

The import was switched to `zod4/v4`, but the expected verification parse call for the zod4-lib schema was not added, so the benchmark update is only partial.

packages/bench/object-moltar.ts:1
Hook sequencing differs from intended workflow
major

Pre-push now runs `pnpm test` before `pnpm semver-check`, diverging from the intended sequence where semver check runs first; this can increase wasted CI/local time and change failure order.

.husky/pre-push:8
Core/runtime tightening is only partially implemented
major

The patch adds some util assertions and `NEVER` export wiring, but it misses several intended runtime consistency edits in core API/check/schema logic, so the release-level behavior alignment is incomplete.

packages/zod/v4/core/util.ts:455