What is redd-archiver CLAUDE.md?

A project guide for Redd-Archiver, which turns compressed data dumps from Reddit and similar link-aggregator sites into browsable static HTML archives. It also describes optional search, an API, and connections to AI tools.

Use it when working on dump importing, PostgreSQL storage, static archive generation, search, the REST API, or MCP integration.

It gives an AI assistant the project's data formats, storage requirements, streaming approach, and intentional design choices before making changes.

How 19-84/redd-archiver configures Claude Code

Reuse

Borrowing it

Nothing to install: this file belongs to 19-84/redd-archiver. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file

curl -O https://raw.githubusercontent.com/19-84/redd-archiver/main/CLAUDE.md

Clone the repo

git clone --depth 1 https://github.com/19-84/redd-archiver

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/instructions/19-84/redd-archiver/claude-md/github.svg)](https://agentmods.dev/instructions/19-84/redd-archiver/claude-md)

Your own site

<a href="https://agentmods.dev/instructions/19-84/redd-archiver/claude-md"><img src="https://agentmods.dev/badge/instructions/19-84/redd-archiver/claude-md/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/instructions/19-84/redd-archiver/claude-md"><img src="https://agentmods.dev/badge/instructions/19-84/redd-archiver/claude-md.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 4,429 This file is loaded in full into every session.

When invoked 4,429 The same file — it is already loaded in full.

Security scan B 2 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.04429	$0.04429
Opus 5.5	$0.01772	$0.01772
Sonnet 5.5	$0.00886	$0.00886
Haiku 4.5	$0.00443	$0.00443

Measured 2mo ago against content hash ec05d32151c8, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade B, and why

redd-archiver CLAUDE.md scanned grade B with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Asks for rootmediumPrivilege escalation

A mod that escalates privileges can change anything on the machine, not only the project.

sudo docker compose up -d --build

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl http://localhost/health # nginx

CLAUDE.md · 454 lines

How it starts

The opening of the file, as written. The whole thing — 454 lines — stays where its author put it; the contents beside it link to each section on GitHub.

CLAUDE.md

This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.

Project Overview

Redd-Archiver is a PostgreSQL-backed archive generator that transforms compressed data dumps from multiple link aggregator platforms (Reddit, Voat, Ruqqus) into browsable static HTML websites with optional server-side full-text search and MCP/AI integration.

Key Characteristics:

Multi-Platform Support: Reddit (.zst), Voat (SQL), Ruqqus (.7z)
Streaming architecture with constant memory usage regardless of dataset size
PostgreSQL-only backend (DATABASE_URL required)
Hybrid output: Static HTML for offline browsing + optional Flask search server
REST API v1 with MCP/AI optimization (see docs/API.md)
MCP Server for Claude Desktop/Claude Code integration (see mcp_server/README.md)
Zero JavaScript design for maximum compatibility

Deviations from Global Standards

This project intentionally deviates from the global ~/.claude/docs/ conventions in these areas. Do not "fix" these to match global standards without explicit permission.

Area	Global Standard	This Project	Rationale
Line length	88	120	HTML string literals, SQL queries, and template paths cause excessive wrapping at 88
Logging	structlog	stdlib `logging`	Predates structlog adoption; migration low priority
Project layout	`src/`	Flat (packages at root)	Historical; changing breaks all Docker COPY paths and imports
Source control	jj preferred	git only	jj not configured for this repo

Build & Run Commands

Docker Development (Primary Method)

# Start all services (postgres, builder, search-server, nginx)
sudo docker compose up -d --build

# Run archive generator (Reddit)
sudo docker compose exec reddarchiver-builder python reddarc.py /data \
  --output /output/ \
  --subreddit privacy \
  --comments-file /data/Privacy_comments.zst \
  --submissions-file /data/Privacy_submissions.zst

# Voat (pre-split files)
sudo docker compose exec reddarchiver-builder python reddarc.py /data/voat_split/submissions/ \
  --subverse privacy \
  --comments-file /data/voat_split/comments/privacy_comments.sql.gz \
  --submissions-file /data/voat_split/submissions/privacy_submissions.sql.gz \
  --platform voat \
  --output /output/

# Ruqqus (.7z files)
sudo docker compose exec reddarchiver-builder python reddarc.py /data/ruqqus/ \
  --guild technology \
  --comments-file /data/ruqqus/comments.fx.2021-10-30.txt.sort.2021-11-08.7z \
  --submissions-file /data/ruqqus/submissions.f1.2021-10-30.txt.sort.2021-11-10.7z \
  --platform ruqqus \
  --output /output/

# View logs / health
sudo docker compose logs -f search-server
curl http://localhost/health       # nginx
curl http://localhost:5000/health  # search-server

Read the full file on GitHub · 454 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

2mo ago First seen · 454 lines · 4,429 tokens per session scan B ec05d32151c8

Subscribe to this mod's changes

redd-archiver CLAUDE.md is an instructions file published in the GitHub repository 19-84/redd-archiver (351 stars, last pushed 4d ago), licensed Unlicense. It adds 4,429 tokens to every session, about $0.0177 per session on Opus 5.5. A static security scan graded it B with 2 findings (asks for root, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

archival archive data-preservation docker full-text-search html-generator

redd-archiver CLAUDE.md next to 6 instructions from other repositories
Mod	Type	Stars	Last push	Licence	Scan	Tokens	Works with
redd-archiver CLAUDE.md19-84/redd-archiver	Instructions file	351	4d ago	Unlicense	B	4,429	Claude Code
vscode buildNext.instructions.mdmicrosoft/vscode	Instructions file	195k	yesterday	MIT	A	9,719	GitHub Copilot
next.js AGENTS.mdvercel/next.js	Instructions file	143k	today	MIT	A	7,461	Codex, OpenCode
langchain AGENTS.mdlangchain-ai/langchain	Instructions file	149k	yesterday	MIT	A	4,680	Codex, OpenCode
vscode oss-third-party-notices.instructions.mdmicrosoft/vscode	Instructions file	195k	yesterday	MIT	A	5,516	GitHub Copilot
vscode copilot-instructions.mdmicrosoft/vscode	Instructions file	195k	yesterday	MIT	A	3,093	GitHub Copilot
deepseek-harness AGENTS.mddeepseek-ai/deepseek-harness	Instructions file	274k	2d ago	MIT	A	4,313	Codex, OpenCode

redd-archiver: Instructions file for Claude Code