Sample output
Agent Performance Scorecard - Revenue Ops Copilot
Tracks how well the copilot triages sales requests, keeps Salesforce contracts in sync, and updates revenue forecasts without introducing regressions.
Overview metrics
Success rate
68%
Tool failure rate
19%
Avg latency
42s
Cost / success
$0.31
ROI score
7.4
Agent type
Internal RevOps analyst assistant
Workflow table
| Workflow | Success rate | Common failure mode | Priority |
|---|---|---|---|
| Lead enrichment & routing | 74% | Field rename in enrichment tool caused 22% of requests to drop required firmographic data. | High |
| Contract amendment drafting | 61% | Tool retries hide schema drift; signature blocks sometimes missing legal entity. | High |
| Forecast commentary | 55% | LLM hallucinated uplift without citing source dashboards. | Medium |
Top 5 fixes
#1 • High impact
Lock Salesforce tool contract
Add schema assertions for required stage + owner fields and surface violations as blocking alerts.
#2 • High impact
Golden trace for contract amendments
Capture 3 representative amendment flows and replay them nightly to ensure retries stay below 3%.
#3 • Medium impact
Cost ceiling policy
Stop-run when blended cost per successful contract > $0.55 and emit latency histogram per tool.
#4 • Medium impact
Cited commentary template
Require dashboard + time range references in commentary outputs to avoid hallucinated spikes.
#5 • Medium impact
ROI trendline
Track delta between manual analyst time saved vs. intervention time to prove net gain every sprint.
CI gate examples
Regression: stage updates skipped
Golden trace ensures opp stage changes persist after prompt tweaks.
- expected: stage = "Proposal" before fix
+ received: stage stayed "Discovery" (blocked deploy)
Tool contract drift: amendContract
Schema enforcement surfaced missing legalEntity parameter in retries.
- required field legalEntity present with registrarId
+ payload omitted legalEntity leading to silent NOP
Cost guardrail failure
CI gate alerted when per-success cost exceeded $0.60 due to new embedding model.
- avg_cost_per_success <= $0.55
+ measured 0.72 (fail, requires approval)