idx-cli/tests/golden
hermes fe627496dd test: add golden output parity gate and live A/B compare
Phase 0 of docs/DESIGN.md, before any refactor code:

- tests/golden.rs runs every case in tests/golden/cases.toml (126
  outputs across help, completions, config, cache, all stocks commands
  on MSN and Yahoo mocks, error paths, and ownership queries on a seeded
  fixture DB) and compares exit code, stdout, and stderr byte for byte.
  Regenerate only with UPDATE_GOLDEN=1 for a reviewed output change.
- scripts/live-smoke.sh --compare <old-idx> runs each live case with
  both binaries and fails on differing exit codes, added/missing/retyped
  JSON keys, or changed values for slow-moving data.
- Exclude golden files from the whitespace/EOF pre-commit fixers, which
  would otherwise rewrite pinned help output.

Both gates were fault-injected: a one-word table change fails exactly
the three history goldens, and a binary dropping profile.long_name fails
only the profile live comparison.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 08:33:25 +00:00
..
cache-clear.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
cache-clear.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
cache-info-empty.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
cache-info-empty.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
cases.toml test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
completions-bash.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
config-get.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
config-init.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
config-path.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
config-set.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-compare-total-failure.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-compare-total-failure.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-fetch-bing-unsupported.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-fetch-bing-unsupported.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-industry-only-fundamentals.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-industry-only-fundamentals.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-invalid-provider.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-invalid-provider.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-offline-cache-miss.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-offline-cache-miss.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-offline-no-cache-flags.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-offline-no-cache-flags.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-provider-failure.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-provider-failure.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-screen-region.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-screen-region.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-usage-missing-symbol.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-usage-missing-symbol.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-yahoo-profile-unsupported.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
error-yahoo-profile-unsupported.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
help-cache.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
help-config.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
help-ownership.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
help-root.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
help-stocks.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-changes.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-changes.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-concentration.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-concentration.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-cross-holders.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-cross-holders.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-entity.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-entity.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-flow.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-flow.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-graph-dot.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-graph-dot.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-graph.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-graph.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-import-archive-txt.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-import-archive-txt.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-import-xlsx.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-import-xlsx.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-releases-empty.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-releases-empty.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-releases.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-releases.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-map.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-map.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-merge.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-merge.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-unresolved.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-resolve-unresolved.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-search.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-search.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker-empty.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker-empty.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker-ksei.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker-ksei.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
ownership-ticker.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-compare.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-compare.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings-forecast-annual.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings-forecast-annual.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings-history-quarterly.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings-history-quarterly.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-earnings.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-financials-income.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-financials-income.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-financials.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-financials.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-fundamental.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-fundamental.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-growth.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-growth.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-history-msn.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-history-msn.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-history.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-history.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-insights.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-insights.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-news.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-news.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-profile.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-profile.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote-multi.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote-multi.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote-offline-warm.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote-offline-warm.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-quote.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-risk.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-risk.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-high-volume.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-high-volume.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-large-cap.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-large-cap.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-worst.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen-worst.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-screen.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-sentiment.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-sentiment.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-technical.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-technical.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-valuation-nonfinite.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-valuation-nonfinite.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-valuation.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
stocks-valuation.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-fundamental.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-fundamental.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-history.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-history.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-quote.json.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00
yahoo-quote.table.golden test: add golden output parity gate and live A/B compare 2026-10-14 08:33:25 +00:00