scrapai-cli CLAUDE.md

scrapai-cli CLAUDE.md is an instructions file for coding agents from discourselab/scrapai-cli. It costs 8,964 tokens per session, scanned A, original, Apache-2.0.

A full instruction manual for an AI assistant working with scrapai, a command-line tool for building web crawlers. It covers project setup, crawler design, browser access, crawling, queues, databases, sessions, and configuration.

In plain words
What is it for?
Use it to guide the assistant through creating spiders, inspecting sites, handling authenticated sessions, running crawls, processing queues, and managing crawler data.
Why use it?
It gives the assistant a defined process for understanding a website, writing crawler rules, testing them, and importing the result. This reduces guesswork when building or maintaining spiders.

Instructions file

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add instructions/discourselab/scrapai-cli/claude-md
Clone the repo
git clone --depth 1 https://github.com/discourselab/scrapai-cli

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for scrapai-cli CLAUDE.md

README.md
[![agentmods](https://agentmods.dev/badge/instructions/discourselab/scrapai-cli/claude-md.svg)](https://agentmods.dev/instructions/discourselab/scrapai-cli/claude-md)
Your own site
<a href="https://agentmods.dev/instructions/discourselab/scrapai-cli/claude-md"><img src="https://agentmods.dev/badge/instructions/discourselab/scrapai-cli/claude-md.svg" alt="Measured on agentmods" height="20"></a>
Per session 8,964 This file is loaded in full into every session.
When invoked 8,964 The same file — it is already loaded in full.
Security scan A 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.08964 $0.08964
Opus 5 $0.04482 $0.04482
Sonnet 5 $0.01793 $0.01793
Haiku 4.5 $0.00896 $0.00896

Measured 4d ago against content hash 2cdc1fe5c56b, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

scrapai-cli CLAUDE.md scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

| `fetch` / `curl` / `wget` | `./scrapai inspect` |
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 4d ago First seen · 338 lines · 8,964 tokens per session scan A 2cdc1fe5c56b

Subscribe to this mod's changes

scrapai-cli CLAUDE.md is an instructions file published in the GitHub repository discourselab/scrapai-cli (115 stars, last pushed 8d ago), licensed Apache-2.0. It adds 8,964 tokens to every session, about $0.0448 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other instructions, from other repositories

mcp-stealth-chrome AGENTS.md

Instructions for RobithYusuf/mcp-stealth-chrome, covering mcp-stealth-chrome — agent guide, product and repository map, hard constraints, working defaults and architecture invariants.

RobithYusuf/mcp-stealth-chrome · 4,144 tokens

mcp-stealth-chrome CLAUDE.md

Instructions for RobithYusuf/mcp-stealth-chrome, a project described as: Stealth Chrome MCP server — 100++ tools for AI agents. One-liner Cloudflare Turnstile bypass (proven), dual-mode HTTP with TLS fingerprint, AI Vision reCAPTCHA solver. Python + nodriver + curlcffi + FastMCP.

RobithYusuf/mcp-stealth-chrome · 3 tokens

Browser4 CLAUDE.md

Claude Code instructions for platonai/Browser4, covering browser4 — project context for claude, architecture, key dispatch chain (cli → browser), batch commands and e2e test structure.

platonai/Browser4 · 1,205 tokens

fast-browser CLAUDE.md

Claude Code instructions for m4ttstack/fast-browser, covering fast browser plugin, where a change belongs, fork branch: use fast-browser-runtime, releasing a new runtime and re-pinning this repo: use the script.

m4ttstack/fast-browser · 1,446 tokens

sendblue-browser-use AGENTS.md

Instructions for sendblue-api/sendblue-browser-use, covering agents.md — sendblue-browser-use, what this repo is, setup, common commands and health (no auth).

sendblue-api/sendblue-browser-use · 1,064 tokens

sniff AGENTS.md

AGENTS.md instructions for Aboudjem/sniff, covering agents.md: sniff, what this repo is, how an agent should use sniff, handling the playwright setup gate and finding output schema.

Aboudjem/sniff · 1,901 tokens