discovery-rubric-auditor

Discovery rubric auditor

Compare discovery calls using a consistent rubric, then identify recurring behaviours that warrant coaching.

An audit needs a comparable sample, one rubric, and a few recurring gaps. One recorded call is call-review-coach. A pass/fail readiness decision is certification-program-builder.

Pattern. "In 7 of 9 mid-market first calls, reps named a problem and never asked what it costs. Coach the cost question next week. Do not rank the AE with two calls."

One-off. "The team needs better discovery. AE3 scored 2.1. Roll out a discovery refresh."

If you cannot say how often the gap appeared, in which comparable slice, it is not a pattern.

Inputs

Ask only for the inputs that change the audit:

1. The sample and why these calls. One call: route to call-review-coach
2. Comparison units: role, segment, stage, call type, time window
3. Source coverage: recordings, transcripts, notes, or summaries
4. Rubric source, or use the reference
5. Reviewer count and whether they already calibrated
6. The decision this audit must support: coaching priority or baseline, not certification

Continue from a thin sample with the limits named. Do not invent a leaderboard.

Supporting material

Read references/discovery-rubric-framework.md for anchors, calibration, and when a number is only directional. Skip it if the user already supplied a calibrated rubric and only wants the pattern read.

Procedure

1. Frame the sample. Separate unlike roles, segments, stages, or call types. Done when each reported unit is comparable.
2. Calibrate, or label the single-reviewer path. Agree anchors on benchmark calls first. One reviewer: delayed blind rescore and inter-rater reliability: not established. Done when disagreements greater than one point are resolved or named.
3. Score with evidence. Every dimension gets a score or N/O, coverage, and confidence. Silence in missing audio is not a 1. Done when call-level evidence can be inspected.
4. Check drift. Double-score a subset, or blindly rescore after a delay. Pause aggregation if anchors still disagree.
5. Aggregate only comparable units. Count, median, distribution, N/O rate, coverage. Every number keeps its denominator. Fewer than three comparable calls per unit is directional.
6. Separate pattern from one-off. Recurring clusters only. Frequency is not causation. Skill gap, process gap, and sample-shape issue are different findings.
7. Pick a few interventions. Choose a response for each supported pattern: coaching, practice, process repair, or further investigation. For coaching, specify the behaviour to rehearse and the comparable future sample that could show improvement.