STET

flux-pr-5578

Zod (TypeScript) · W2 · GPT-5.3 Codex

pass_with_warn

Tests passed. 2/2 commands passed. Strength: strong.

69.2% run pass rate
Tier 1
primary testspassednon equivalentfail
pnpm build
gold passagent pass
pnpm test -- --testTimeout 20000 --maxWorkers 1 --maxConcurrency 1 --retry 2
gold passagent pass

Partial score: 2/2

Publishable: yesCache: miss

Trajectory

unknown · partial order only

Canonical trajectory missing; showing coarse derived order only.

patch written
Patch captured
#1

Stet captured agent.patch for this trial.

validation
Tests passed
#2
equivalence
Equivalence judgment
#3

non_equivalent

code review
Code review judgment
#4

fail

decision
Final decision
#5

pass_with_warn

Quality

equivalence
non_equivalent
89% confidence
code review
fail
3 findings
footprint
low (0.19)
behavioral
100.0%
cost
$4.48 · 1.8M

Equivalence Reasoning

behavioral

The agent patch only partially addresses the intent. It adds `parent: true` cloning and improves processing for non-pure clones, plus exposes `parentZodSchema` to `override`, but it does not implement the core parent/ref tracking and inheritance behavior needed during JSON Schema finalization. It misses the separate `parent` tracking in seen state, parent `$ref` propagation when wrappers/processors set `ref`, and dedup/merge safeguards that prevent redundant parent property replay while preserving child overrides. It also omits the `fileProcessor` dedup change present in the intended behavior.

Code Review

correctness: 1/4introduced bug risk: 1/4edge case handling: 1/4maintainability idioms: 2/4

The agent patch appears incomplete versus the intended metadata-propagation fix: it partially adds parent tracking for clones and override callbacks, but misses key parent/ref inheritance and dedup semantics in JSON-schema finalization, so it likely does not fully satisfy the task.

3 findings
Processor execution is skipped for pure clones
major

The new `isPureClone` gate bypasses `processJSONSchema`/processor execution when cloned schemas share the same `def` object. This can suppress emission of schema details that still need to be materialized on cloned/refined nodes.

packages/zod/src/v4/core/to-json-schema.ts:174
Parent/reference flattening remains incomplete
major

Finalize still follows the old ref-flatten pattern and only adds `parentZodSchema` for override context. It does not implement robust parent-chain dedup/propagation behavior needed when parent schemas are extracted or wrapped.

packages/zod/src/v4/core/to-json-schema.ts:385
Patch shifts to callback API changes instead of core metadata pipeline fix
major

Adding `parentZodSchema` to override context and tests centered on that field introduces API/behavior surface area, but the main inheritance mechanics are not equivalently strengthened, creating mismatch between tests and intended internal guarantees.

packages/zod/src/v4/core/to-json-schema.ts:29