scrape-url

Scrape URL and Create Note

Scrape content from a URL and create a comprehensive knowledge graph note using question-oriented content synthesis.

Usage

/scrape-url <url> [note_filename]

Process

Step 1: Content Acquisition (Web-Specific)

Scrape the URL using mcp__firecrawl__firecrawl_scrape:

• Format: markdown
• Include main content only
• Extract all text, examples, code snippets

Analyze page metadata:

• Extract title, author, publication date if available
• Identify domain/source (blog, documentation, academic, etc.)
• Note any special formatting or structure

Read the scraped content:

• This is the raw content to be synthesized

Step 2: Universal Content Processing

Follow the shared content synthesis pipeline documented in _shared_content_synthesis.md:

1. Apply Question-Oriented Content Synthesis

   • Phase 1: Central Question Discovery
   • Phase 2: Domain Question Extraction
   • Phase 3: Specific and Atomic Question Decomposition
   • Phase 4: Progressive Answer Development

2. Generate note structure and metadata

   • Determine filename based on central question
   • Assign 3-6 tags mixing dimensions
   • Create web-specific YAML frontmatter

3. MOC Integration

   • Read TOPICS.md to understand MOC structure
   • Identify appropriate MOC(s) for this note
   • Update MOC file(s) with wikilink and description

4. Relationship Discovery

   • Search for related notes in knowledge graph
   • Establish bidirectional relationships
   • Update related notes

Web-Specific Note Structure

---
tags: [domain, technology, content-type]
source: <original_url>
date_added: <ISO_date>
---

# Note Title (Based on Central Question)

## Central Question

**Question**: [The single overarching question the content addresses]

**Executive Summary**: 2-3 paragraphs previewing key insights and how the content resolves the central question.

## Part I: [Domain Question 1]

### [Specific Question 1.1]

**Question**: [Clear, specific question from this section]

**Answer**: [Comprehensive response including:
- Direct answer to the question
- Supporting evidence from article (specific quotes, examples, data)
- Technical details and concrete information
- Implications and connections to broader themes]

### [Specific Question 1.2]

**Question**: [Next specific question]

**Answer**: [Evidence-based response...]

## Part II: [Domain Question 2]

### [Specific Question 2.1]

**Question**: [Clear question]

**Answer**: [Comprehensive response with article evidence...]

[Continue with additional parts and sections as needed]

## Resolution: [Answer to Central Question]

Synthesize domain insights to definitively resolve the central question posed at the beginning.

## Related Concepts

### Prerequisites
- [[prerequisite]] - Why needed first

### Related Topics
- [[related]] - Connection explanation

### Extends
- [[base_concept]] - What this builds upon

## References

- [Article Title](<original_url>) - Brief description
- Accessed: <date>