debt-ops-metrics

debt-ops-metrics

Read the hidden metrics log and tell the user whether the tripwires are tripping.

1. Find the log

The repo-hash is computed in Python (not shasum) so this is identical across macOS, Linux, and Windows — no BSD/GNU coreutils dependency.

REPO_HASH=$(python3 -c "import hashlib,subprocess;t=subprocess.run(['git','rev-parse','--show-toplevel'],capture_output=True,text=True).stdout.strip();print(hashlib.sha1(t.encode()).hexdigest()[:12] if t else '')")

# Hooks and skills share one deterministic cache base. Override with
# DEBT_OPS_CACHE; default is ~/.cache/debt-ops.
CACHE_DIR="${DEBT_OPS_CACHE:-$HOME/.cache/debt-ops}/cache/$REPO_HASH"

LOG="$CACHE_DIR/metrics.jsonl"
if [ -n "$REPO_HASH" ] && [ -f "$LOG" ]; then
  tail -n 500 "$LOG"
else
  echo "MISSING: no metrics.jsonl found for repo hash ${REPO_HASH:-<not-a-git-repo>}"
fi

If the file is missing or empty, tell the user no debt-ops activity has been logged for this repo yet and stop. On a skills-only tool (no hook adapter), only register and review events are logged — the per-edit edit/feedback/session events come from the hook adapter, so feedback metrics will be absent. Say so rather than reporting them as zero.

2. The log format

One JSON object per line. Event shapes:

• {"event":"register","slug":"...","ai_authored":bool,"letter":"...","ts":"..."} — each capture
• {"event":"review","total":N,"stale":N,"cold":N,"active":N,"ts":"..."} — each review
• {"event":"edit","file":"...","registry_count":N,"ts":"..."} — every agent edit (hook adapter only)
• {"event":"feedback","file":"...","result":"pass|fail","ts":"..."} — every quality-check fire (hook adapter only)
• {"event":"session","registry_count":N,"adr_count":M,"ai_authored_count":K,"ts":"..."} — start of each session (hook adapter only)

Timestamps are ISO-8601 UTC.

3. Compute the tripwires

Filter to the last 7 days. Then compute what the available events support:

• Captures / reviews — counts of event:register and event:review.
• AI-authored share — share of register events with ai_authored:true.
• Edits / sessions (hook adapter only) — counts of event:edit and event:session.
• Registry growth (hook adapter only) — last registry_count minus first.
• Feedback pass rate (hook adapter only) — count(result:pass) / count(event:feedback).
• FAIL → PASS rate (hook adapter only) — for each feedback with result:fail, look at the next feedback for the same file; count those that flipped to pass; divide by total fails. Below 50% means the agent isn't reliably acting on hook output — the architectural alarm bell.