idx-cli/scripts
hermes fe627496dd test: add golden output parity gate and live A/B compare
Phase 0 of docs/DESIGN.md, before any refactor code:

- tests/golden.rs runs every case in tests/golden/cases.toml (126
  outputs across help, completions, config, cache, all stocks commands
  on MSN and Yahoo mocks, error paths, and ownership queries on a seeded
  fixture DB) and compares exit code, stdout, and stderr byte for byte.
  Regenerate only with UPDATE_GOLDEN=1 for a reviewed output change.
- scripts/live-smoke.sh --compare <old-idx> runs each live case with
  both binaries and fails on differing exit codes, added/missing/retyped
  JSON keys, or changed values for slow-moving data.
- Exclude golden files from the whitespace/EOF pre-commit fixers, which
  would otherwise rewrite pinned help output.

Both gates were fault-injected: a one-word table change fails exactly
the three history goldens, and a binary dropping profile.long_name fails
only the profile live comparison.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 08:33:25 +00:00
..
audit-msn-fundamentals.sh fix: handle non-finite msn key ratios 2026-04-13 23:34:36 +07:00
build-latest-ownership-snapshot.sh fix(ownership): bound snapshot download by manifest size; clean refused builds 2026-09-25 22:31:40 +00:00
build-ownership-snapshot.sh fix(ownership): verify snapshot assets before publishing manifests 2026-09-25 10:37:32 +00:00
check-ownership-snapshot-freshness.sh fix(ownership): make publisher RESULT contract hold on every path 2026-09-24 21:50:51 +00:00
idx.js fix: harden npm distribution release and installer 2026-09-24 18:57:53 +00:00
install-sh-test.sh ci(nix): unify cached verification and strengthen packaged smoke 2026-10-03 16:22:11 +00:00
install.js fix: harden npm distribution release and installer 2026-09-24 18:57:53 +00:00
live-smoke.sh test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
npm-smoke.sh fix: harden npm distribution release and installer 2026-09-24 18:57:53 +00:00
publish-ownership-snapshot-test.sh ci(nix): unify cached verification and strengthen packaged smoke 2026-10-03 16:22:11 +00:00
publish-ownership-snapshot.sh fix(ownership): sync snapshots over 10 MiB; refuse oversized publishes 2026-09-25 22:22:48 +00:00