Grafana dashboard templates for AIR Blackbox metrics

[shotwellj]

Summary

Ship pre-built Grafana dashboard JSON files that visualize AIR Blackbox metrics out of the box. This makes the value of the observability pipeline immediately visible to new users.

Dashboards

• Agent Overview — requests/sec, tokens/sec, cost/hour, active agents
• Policy Engine — rules evaluated, blocks, warnings, top triggered rules
• Cost Tracker — per-model spend, per-agent spend, budget utilization
• PII & Security — redactions/hour, blocked tool calls, risk tier distribution
• Episode Replay — episodes/hour, avg steps per episode, failure rate

Implementation

• Grafana JSON models in /dashboards directory
• Docker Compose addition for Grafana + Prometheus
• Provisioning config for auto-import on startup

Milestone

v0.3.0