feat: Add judge evaluation support to agent graphs#142

Open

jsonbailey wants to merge 10 commits intomainfrom

jb/aic-2267/agent-graph-judge-support

Commits on Apr 24, 2026

feat: add judge evaluation support to agent graphs

jsonbailey
and
claude
committed
fix: address PR review feedback

jsonbailey
and
claude
committed
fix: preserve eval tasks for repeated node visits and fix lint

jsonbailey
and
claude
committed

Commits on Apr 27, 2026

fix: collect and await judge eval tasks instead of fire-and-forget

jsonbailey
and
claude
committed
fix: remove unnecessary tracker guards, forward variables and default_ai_provider

jsonbailey
and
claude
committed
fix: eliminate fire-and-forget tasks and harden eval task tracking

jsonbailey
and
claude
committed
chore: merge main into branch, resolve client.py conflicts

jsonbailey
and
claude
committed
fix: populate AgentGraphResult.evaluations and clean up remaining review items

jsonbailey
and
claude
committed
fix: add future annotations import and log judge init failures

jsonbailey
and
claude
committed
fix: remove judge evaluations from OpenAI runner

jsonbailey
and
claude
committed