agent-wiki-ingest

Agent Wiki — Ingest (end-to-end orchestrator)

Overview

This is the one-pass entry point for turning a batch of raw trajectories into a fully-built wiki. It orchestrates the rest of the agent-wiki family in the right order so no pass is skipped — in particular the cross-trajectory consolidation pass, which is easy to forget when each skill is invoked by hand.

You — the driving agent — run this by spawning one subagent per (trace × pass), not by doing the work inline. That keeps your own context small (you never load every trace's full JSON) and lets independent passes run in parallel. Each subagent acts as the corresponding single-purpose skill (agent-wiki-summarize, -extract-guidelines, -synthesize-skill, -compare-outcomes, -consolidate-guidelines); this skill only sequences them and passes the per-trace adapter notes.

The pipeline:

0.  Convert    raw bob / claude traces → normalized analysis JSON   (skip if already normalized)
1.  Bootstrap  create wiki scaffold + seed catalog                  (skip if wiki exists)
1.5 Skip       drop traces whose summaries/<sid>.md already exists   [pre-flight — idempotency]
2.  Summarize  1 subagent / new-trace → summaries/<sid>.md          [PARALLEL]
3.  Extract    1 subagent / new-trace → guidelines/*.md (+tags)     [SEQUENTIAL]
4.  Synthesize 1 subagent / new-trace → skills/<slug>/ --archive-covered  [SEQUENTIAL]
4.5 Compare    success/failure contrasts → contrastive guidelines   [CONDITIONAL]
5.  Consolidate 1 subagent over the whole corpus → cluster pages    [SINGLE — MANDATORY]
6.  Catalog    final bookkeeping → indexes, used-by, priority       [you run this directly]

Idempotent by default. Re-running on the same source dir reprocesses nothing: Step 1.5 filters out every trace that already has a summary page, so Steps 2–4 only touch genuinely new traces. The consolidate + catalog tail always runs (it's cheap and self-idempotent). To force a redo of an already- ingested trace, keep it in the list and pass --rewrite to its render-* calls.