Example output — illustrative
Example AI Workflow Scorecard
Tracks how well the copilot triages sales requests, keeps Salesforce contracts in sync, and updates revenue forecasts without introducing regressions.
Illustrative layout with placeholder values. Your scorecard is populated from your own traces, tasks, and tool calls.
Overview metrics
Success rate
68%
Tool failure rate
19%
Avg latency
42s
Cost / success
$0.31
Reliability index
7.4
Workflow type
Internal RevOps analyst assistant
Workflow table
| Workflow | Success rate | Common failure mode | Priority |
|---|---|---|---|
| Lead enrichment & routing | 74% | Field rename in enrichment tool caused 22% of requests to drop required firmographic data. | High |
| Contract amendment drafting | 61% | Tool retries hide schema drift; signature blocks sometimes missing legal entity. | High |
| Forecast commentary | 55% | LLM hallucinated uplift without citing source dashboards. | Medium |
Top 5 fixes
#1 • High impact
Lock Salesforce tool contract
Add schema assertions for required stage + owner fields and surface violations as blocking alerts.
#2 • High impact
Golden trace for contract amendments
Capture 3 representative amendment flows and replay them nightly to ensure retries stay below 3%.
#3 • Medium impact
Cost ceiling policy
Stop-run when blended cost per successful contract > $0.55 and emit latency histogram per tool.
#4 • Medium impact
Cited commentary template
Require dashboard + time range references in commentary outputs to avoid hallucinated spikes.
#5 • Medium impact
ROI trendline
Track delta between manual analyst time saved vs. intervention time to prove net gain every sprint.
CI gate examples
Regression: stage updates skipped
Golden trace ensures opp stage changes persist after prompt tweaks.
- expected: stage = "Proposal" before fix
+ received: stage stayed "Discovery" (blocked deploy)
Tool contract drift: amendContract
Schema enforcement surfaced missing legalEntity parameter in retries.
- required field legalEntity present with registrarId
+ payload omitted legalEntity leading to silent NOP
Cost guardrail failure
CI gate alerted when per-success cost exceeded $0.60 due to new embedding model.
- avg_cost_per_success <= $0.55
+ measured 0.72 (fail, requires approval)