test(agents): the new cases check the arguments that answer the prompt

The release-gate Codex review: news passed on get_company with only
`sections: ["profile"]`, history on any period, search on any query.
Require `sections: ["news"]`, `period: "1mo"`, `filter: "top-performers"`
and a query containing "Salim"; all 24 calls from the last six-harness
run still pass.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01V3syn2fN2LNo5pvTSqc6eh
This commit is contained in:
hermes 2026-10-16 09:48:03 +00:00
commit 30449d9ac6

View file

@ -42,25 +42,25 @@
{ {
"id": "news", "id": "news",
"prompt": "What is the latest news about BBCA?", "prompt": "What is the latest news about BBCA?",
"expect_tools": [{"name": "get_company", "args": {"symbol": "BBCA"}}], "expect_tools": [{"name": "get_company", "args": {"symbol": "BBCA", "sections": ["news"]}}],
"expect_text": [] "expect_text": []
}, },
{ {
"id": "history", "id": "history",
"prompt": "Show BBCA's daily closing prices for the past month.", "prompt": "Show BBCA's daily closing prices for the past month.",
"expect_tools": [{"name": "get_price_history", "args": {"symbol": "BBCA"}}], "expect_tools": [{"name": "get_price_history", "args": {"symbol": "BBCA", "period": "1mo"}}],
"expect_text": [] "expect_text": []
}, },
{ {
"id": "screen", "id": "screen",
"prompt": "Which IDX stocks are the top performers today?", "prompt": "Which IDX stocks are the top performers today?",
"expect_tools": [{"name": "screen_stocks"}], "expect_tools": [{"name": "screen_stocks", "args": {"filter": "top-performers"}}],
"expect_text": [] "expect_text": []
}, },
{ {
"id": "search", "id": "search",
"prompt": "Search the KSEI ownership database for investors named Salim.", "prompt": "Search the KSEI ownership database for investors named Salim.",
"expect_tools": [{"name": "search_investors"}], "expect_tools": [{"name": "search_investors", "args": {"query": "Salim"}}],
"expect_text": [] "expect_text": []
} }
] ]