idx-cli/tests/agents/cases.json
hermes 30449d9ac6 test(agents): the new cases check the arguments that answer the prompt
The release-gate Codex review: news passed on get_company with only
`sections: ["profile"]`, history on any period, search on any query.
Require `sections: ["news"]`, `period: "1mo"`, `filter: "top-performers"`
and a query containing "Salim"; all 24 calls from the last six-harness
run still pass.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01V3syn2fN2LNo5pvTSqc6eh
2026-10-16 09:48:03 +00:00

66 lines
2.3 KiB
JSON

[
{
"id": "shareholders",
"prompt": "Who are the shareholders above 5% of BBCA?",
"expect_tools": [{"name": "get_shareholders", "args": {"ticker": "BBCA"}}],
"expect_text": ["(?i)dwimuria", "54[.,]9"]
},
{
"id": "quote",
"prompt": "What is the latest BBCA share price?",
"expect_tools": [{"name": "get_quotes", "args": {"symbols": ["BBCA"]}}],
"expect_text": ["(?i)bbca"]
},
{
"id": "compare",
"prompt": "Compare the fundamentals of BBCA and BBRI.",
"expect_tools": [{"name": "compare_stocks", "args": {"symbols": ["BBCA", "BBRI"]}}],
"expect_text": ["(?i)bbri"]
},
{
"id": "technical",
"prompt": "Give me a technical analysis of BBCA: trend, RSI, and MACD.",
"expect_tools": [{"name": "analyze_stock", "args": {"symbol": "BBCA"}}],
"expect_text": ["(?i)rsi"]
},
{
"id": "investor",
"prompt": "Which IDX stocks does Anthoni Salim hold above 1%?",
"expect_tools": [{"any": ["get_investor_holdings", "search_investors"]}],
"expect_text": ["(?i)bbca"]
},
{
"id": "changes",
"prompt": "Which shareholders changed between the 2026-01-30 and 2026-02-27 KSEI releases?",
"expect_tools": [{"name": "get_ownership_changes", "args": {"from": "2026-01-30", "to": "2026-02-27"}}],
"expect_text": [],
"live": {
"prompt": "Which shareholders changed between the two most recent KSEI releases?",
"expect_tools": [{"name": "get_ownership_changes", "args": {"from": "{previous_release}", "to": "{latest_release}"}}]
}
},
{
"id": "news",
"prompt": "What is the latest news about BBCA?",
"expect_tools": [{"name": "get_company", "args": {"symbol": "BBCA", "sections": ["news"]}}],
"expect_text": []
},
{
"id": "history",
"prompt": "Show BBCA's daily closing prices for the past month.",
"expect_tools": [{"name": "get_price_history", "args": {"symbol": "BBCA", "period": "1mo"}}],
"expect_text": []
},
{
"id": "screen",
"prompt": "Which IDX stocks are the top performers today?",
"expect_tools": [{"name": "screen_stocks", "args": {"filter": "top-performers"}}],
"expect_text": []
},
{
"id": "search",
"prompt": "Search the KSEI ownership database for investors named Salim.",
"expect_tools": [{"name": "search_investors", "args": {"query": "Salim"}}],
"expect_text": []
}
]