Eval-Agent
SigNoz
Overview
Runs
Compare
Alerts
Demo
offline
Live
K
SigNoz integration
One click wires up the eval quality dashboard, the alert rule, and the webhook channel that lets the copilot auto-investigate — all through the SigNoz API. Idempotent, safe to re-run.
Set up in SigNoz
Quality dashboard
eval.quality_score · cost · tokens · traces evaluated
Alert rule
avg(eval.quality_score) < 70, grouped by run_id
Webhook channel
routes firing alerts to the copilot's /signoz/alert
Eval quality dropped
Fires when
avg(eval.quality_score) < 70
for a run. Wired to the
eval-copilot-webhook
channel in SigNoz.
armed
SigNoz alert fires
POST /signoz/alert
copilot auto-investigates
Investigation history
durable · survives restarts
Runs breaching threshold
quality < 70
Eval-Agent SigNoz