wiki-ingest

Wiki Ingest

Distill external sources into vault-native notes following VAULT_CONVENTIONS, with provenance tracking and deduplication.

Workflow

1. Identify Sources

Accept one or more source paths from the user. Sources can be:

• Files on disk (markdown, PDF, text, transcripts)
• Vault-internal notes (Readwise highlights, working notes to promote)
• A directory to scan for ingestible files

For vault-internal sources, use obsidian_read_note. For external files, use the Read tool.

2. Check Manifest

Read .manifest.json from the vault root using Read tool.

For each source path, check if it exists in sources:

• Not present → new source, proceed to extract
• Present but source modified since ingested_at → re-ingest
• Present and unchanged → skip (tell user "already ingested, use --force to re-process")

3. Extract Knowledge

Read the source content. Identify:

• Patterns — reusable approaches, techniques, or practices
• Traps — pitfalls, anti-patterns, things that went wrong
• Decisions — architectural or design choices with rationale
• Concepts — definitions, mental models, frameworks

For each extraction, classify its provenance:

• Extracted (unmarked) — directly stated in the source
• Inferred ^[inferred] — synthesized, generalized, or implied but not stated
• Ambiguous ^[ambiguous] — source is unclear or contradicts other sources

4. Deduplicate

For each extracted concept, search the vault:

1. Call obsidian_rag_query with the concept name/summary, limit: 5
2. If a strong match exists, read the existing note with obsidian_read_note
3. Decide: merge into existing note or create new note

Merge when: the existing note covers the same concept and the new source adds information. Create when: no existing note covers this concept, or the angle is sufficiently different.

5. Present Plan

Before creating or modifying any notes, present the plan to the user:

## Ingest Plan for: <source name>

### New Notes
- Engineering/Patterns/<name>.md — <one-line summary>
- Engineering/Traps/<name>.md — <one-line summary>

### Merge Into Existing
- Engineering/Patterns/<existing>.md — adding: <what's new>

### Skipped
- <concept> — already covered in [[existing-note]]