arxiv-doc-builder

arXiv Document Builder

Automatically converts arXiv papers into structured Markdown documentation for implementation reference.

Capabilities

This skill automatically:

1. Fetches paper materials from arXiv

   • Attempts to download LaTeX source (preferred) and PDF (idempotent — skips if cached)
   • Handles all HTTP requests, extraction, and directory setup

2. Converts LaTeX source to structured Markdown (happy path)

   • LaTeX source → Markdown via pandoc (preserves all math and structure)
   • Preserves mathematical formulas in MathJax/LaTeX format ($...$, $$...$$)
   • Maintains section hierarchy and document structure
   • Includes abstracts, figures, and references

3. PDF fallback (naive — output quality must be verified)

   • When no LaTeX source is available, convert-paper runs convert_pdf_simple.py (single-column pdfplumber extraction) as a best-effort fallback
   • This produces usable output only for simple, single-column papers
   • For 2-column papers, math-heavy papers, or complex layouts, inspect the output and use the specialized PDF scripts manually (see below)

4. Generates implementation-ready documentation

   • Output saved to {ARXIV_ID}/{ARXIV_ID}.md under the output directory (default: current working directory)
   • Easy to reference during code implementation
   • Optimized for Claude to read and understand

When to Use This Skill

Invoke this skill when the user requests:

• "Convert arXiv paper {ID} to markdown"
• "Fetch and process paper {ID}"
• "Create documentation for arXiv:{ID}"
• "I need to read/reference paper {ID}"

How It Works

Single Entry Point

Use the main orchestrator script or the globally installed convert-paper command:

# Using global command (recommended)
convert-paper ARXIV_ID [--output-dir DIR]

# Using script directly
uv run arxiv_doc_builder/convert_paper.py ARXIV_ID [--output-dir DIR]

• --output-dir: Directory where {ARXIV_ID}/{ARXIV_ID}.md will be created. Default: current working directory (not a papers/ subdirectory).
• Use absolute paths to control output location precisely.
• -V / --version: Print the version and exit. Resolves from installed distribution metadata, falling back to pyproject.toml when run straight from the source tree (the uninstalled case for uv run …/convert_paper.py).