mirror of
https://github.com/0xrsydn/idx-cli.git
synced 2026-11-07 09:45:36 +00:00
test: add golden output parity gate and live A/B compare
Phase 0 of docs/DESIGN.md, before any refactor code: - tests/golden.rs runs every case in tests/golden/cases.toml (126 outputs across help, completions, config, cache, all stocks commands on MSN and Yahoo mocks, error paths, and ownership queries on a seeded fixture DB) and compares exit code, stdout, and stderr byte for byte. Regenerate only with UPDATE_GOLDEN=1 for a reviewed output change. - scripts/live-smoke.sh --compare <old-idx> runs each live case with both binaries and fails on differing exit codes, added/missing/retyped JSON keys, or changed values for slow-moving data. - Exclude golden files from the whitespace/EOF pre-commit fixers, which would otherwise rewrite pinned help output. Both gates were fault-injected: a one-word table change fails exactly the three history goldens, and a binary dropping profile.long_name fails only the profile live comparison. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
29796f0f9d
commit
fe627496dd
133 changed files with 6033 additions and 23 deletions
41
tests/golden/yahoo-fundamental.json.golden
Normal file
41
tests/golden/yahoo-fundamental.json.golden
Normal file
|
|
@ -0,0 +1,41 @@
|
|||
exit: 0
|
||||
--- stdout
|
||||
{
|
||||
"symbol": "BBCA.JK",
|
||||
"growth": {
|
||||
"revenue_growth": 0.118,
|
||||
"earnings_growth": 0.121,
|
||||
"revenue_growth_pct": 11.8,
|
||||
"earnings_growth_pct": 12.1,
|
||||
"revenue_signal": "moderate",
|
||||
"earnings_signal": "moderate",
|
||||
"overall_signal": "growing"
|
||||
},
|
||||
"valuation": {
|
||||
"pe_trailing": 25.4,
|
||||
"pe_forward": 23.1,
|
||||
"pb": 4.6,
|
||||
"roe": 0.202,
|
||||
"roe_pct": 20.2,
|
||||
"net_margin": 0.385,
|
||||
"net_margin_pct": 38.5,
|
||||
"ev_ebitda": 21.28,
|
||||
"pe_signal": "premium",
|
||||
"pb_signal": "expensive",
|
||||
"roe_signal": "excellent",
|
||||
"margin_signal": "excellent",
|
||||
"ev_ebitda_signal": "expensive",
|
||||
"overall_signal": "expensive"
|
||||
},
|
||||
"risk": {
|
||||
"debt_to_equity": 18.5,
|
||||
"current_ratio": 1.21,
|
||||
"roa": 0.038,
|
||||
"roa_pct": 3.8,
|
||||
"de_signal": "conservative",
|
||||
"current_ratio_signal": "tight",
|
||||
"overall_signal": "moderate risk"
|
||||
},
|
||||
"overall_signal": "mixed"
|
||||
}
|
||||
--- stderr
|
||||
Loading…
Add table
Add a link
Reference in a new issue