What is redd-archiver CLAUDE.md?

A project guide for Redd-Archiver, which turns compressed data dumps from Reddit and similar link-aggregator sites into browsable static HTML archives. It also describes optional search, an API, and connections to AI tools.

Use it when working on dump importing, PostgreSQL storage, static archive generation, search, the REST API, or MCP integration.

It gives an AI assistant the project's data formats, storage requirements, streaming approach, and intentional design choices before making changes.

redd-archiver CLAUDE.md — Instructions file for coding agents by 19-84: A project guide for Redd-Archiver, which turns compressed data…

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods

npx agentmods add instructions/19-84/redd-archiver/claude-md

Clone the repo

git clone --depth 1 https://github.com/19-84/redd-archiver

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/instructions/19-84/redd-archiver/claude-md.svg)](https://agentmods.dev/instructions/19-84/redd-archiver/claude-md)

Your own site

<a href="https://agentmods.dev/instructions/19-84/redd-archiver/claude-md"><img src="https://agentmods.dev/badge/instructions/19-84/redd-archiver/claude-md.svg" alt="Measured on agentmods" height="20"></a>

Per session 4,429 This file is loaded in full into every session.

When invoked 4,429 The same file — it is already loaded in full.

Security scan B 2 findings. Scan, not verified.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5	$0.04429	$0.04429
Opus 5	$0.02214	$0.02214
Sonnet 5	$0.00886	$0.00886
Haiku 4.5	$0.00443	$0.00443

Measured 5d ago against content hash ec05d32151c8, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade B, and why

redd-archiver CLAUDE.md scanned grade B with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Asks for rootmediumPrivilege escalation

A mod that escalates privileges can change anything on the machine, not only the project.

sudo docker compose up -d --build

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl http://localhost/health # nginx

CLAUDE.md · 454 lines

How it starts

The opening of the file, as written. The whole thing — 454 lines — stays where its author put it; the contents beside it link to each section on GitHub.

CLAUDE.md

This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.

Project Overview

Redd-Archiver is a PostgreSQL-backed archive generator that transforms compressed data dumps from multiple link aggregator platforms (Reddit, Voat, Ruqqus) into browsable static HTML websites with optional server-side full-text search and MCP/AI integration.

Key Characteristics:

Multi-Platform Support: Reddit (.zst), Voat (SQL), Ruqqus (.7z)
Streaming architecture with constant memory usage regardless of dataset size
PostgreSQL-only backend (DATABASE_URL required)
Hybrid output: Static HTML for offline browsing + optional Flask search server
REST API v1 with MCP/AI optimization (see docs/API.md)
MCP Server for Claude Desktop/Claude Code integration (see mcp_server/README.md)
Zero JavaScript design for maximum compatibility

Deviations from Global Standards

This project intentionally deviates from the global ~/.claude/docs/ conventions in these areas. Do not "fix" these to match global standards without explicit permission.

Area	Global Standard	This Project	Rationale
Line length	88	120	HTML string literals, SQL queries, and template paths cause excessive wrapping at 88
Logging	structlog	stdlib `logging`	Predates structlog adoption; migration low priority
Project layout	`src/`	Flat (packages at root)	Historical; changing breaks all Docker COPY paths and imports
Source control	jj preferred	git only	jj not configured for this repo

Build & Run Commands

Docker Development (Primary Method)

# Start all services (postgres, builder, search-server, nginx)
sudo docker compose up -d --build

# Run archive generator (Reddit)
sudo docker compose exec reddarchiver-builder python reddarc.py /data \
  --output /output/ \
  --subreddit privacy \
  --comments-file /data/Privacy_comments.zst \
  --submissions-file /data/Privacy_submissions.zst

# Voat (pre-split files)
sudo docker compose exec reddarchiver-builder python reddarc.py /data/voat_split/submissions/ \
  --subverse privacy \
  --comments-file /data/voat_split/comments/privacy_comments.sql.gz \
  --submissions-file /data/voat_split/submissions/privacy_submissions.sql.gz \
  --platform voat \
  --output /output/

# Ruqqus (.7z files)
sudo docker compose exec reddarchiver-builder python reddarc.py /data/ruqqus/ \
  --guild technology \
  --comments-file /data/ruqqus/comments.fx.2021-10-30.txt.sort.2021-11-08.7z \
  --submissions-file /data/ruqqus/submissions.f1.2021-10-30.txt.sort.2021-11-10.7z \
  --platform ruqqus \
  --output /output/

# View logs / health
sudo docker compose logs -f search-server
curl http://localhost/health       # nginx
curl http://localhost:5000/health  # search-server

Read the full file on GitHub · 454 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

5d ago First seen · 454 lines · 4,429 tokens per session scan B ec05d32151c8

Subscribe to this mod's changes

redd-archiver CLAUDE.md is an instructions file published in the GitHub repository 19-84/redd-archiver (343 stars, last pushed 11d ago), licensed Unlicense. It adds 4,429 tokens to every session, about $0.0221 per session on Opus 5. A static security scan graded it B with 2 findings (asks for root, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

archival archive data-preservation docker full-text-search html-generator

redd-archiver CLAUDE.md

Getting it into your agent

Wrote this? Show the measurements

What it costs to keep this loaded

Grade B, and why

Asks for rootmediumPrivilege escalation

Makes network callslowCapability

How it starts

CLAUDE.md

Project Overview

Deviations from Global Standards

Build & Run Commands

Docker Development (Primary Method)

What this file has done since we first saw it

Other instructions, from other repositories

telegram-archive-mcp CLAUDE.md

appwrite AGENTS.md

netdata AGENTS.md

selfhost-ai CLAUDE.md

SForum AGENTS.md

homelab-monitor CLAUDE.md