feat(appkit): eval suite features — concurrency, retries, reporters (stack 4/5) - #480

Open

MarioCadenas wants to merge 8 commits into

mainfrom

pr/agent-evals-4-suite

Commits on Sep 9, 2026

refactor(appkit): dedupe databricks credential resolution in agent eval CLI
MarioCadenas
committed
866c0aa
feat(appkit): assert tool-call arguments in agent evals
MarioCadenas
committed
b5c97f7
feat(appkit): replay multi-turn dataset rows
MarioCadenas
committed
22bfd31
feat(appkit): gate eval runs on aggregate pass rate
MarioCadenas
committed
14d6e58
feat(appkit): enforce eval timeout, load evals.config.ts, filter by tag
MarioCadenas
committed
069c2de
feat(appkit): retry evals that fail on infra errors
MarioCadenas
committed
01e48a4
feat(appkit): json and junit eval reporters
MarioCadenas
committed
b301824
test(appkit): use server/agents layout in eval config discovery fixtures
MarioCadenas
committed
ed257ed