Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add alex-on-ai/WebReaper --skill skillgit clone --depth 1 https://github.com/alex-on-ai/WebReaperWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/alex-on-ai/webreaper/skill)<a href="https://agentmods.dev/skills/alex-on-ai/webreaper/skill"><img src="https://agentmods.dev/badge/skills/alex-on-ai/webreaper/skill.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00413 | $0.03028 |
| Opus 5 | $0.00206 | $0.01514 |
| Sonnet 5 | $0.00083 | $0.00606 |
| Haiku 4.5 | $0.00041 | $0.00303 |
Grade C, and why
webreaper scanned grade C with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Downloads and executes remote codehighSupply chain
curl | sh runs whatever the server returns today, which is not necessarily what it returned when this was reviewed.
`curl -fsSL https://raw.githubusercontent.com/alex-on-ai/WebReaper/master/scripts/install.sh | sh` Makes network callslowCapability
Not a fault in itself. Listed so you know the mod talks to something, and to what.
`curl -fsSL https://raw.githubusercontent.com/alex-on-ai/WebReaper/master/scripts/install.sh | sh` How it starts
The opening of the file, as written. The whole thing — 236 lines — stays where its author put it; the contents beside it link to each section on GitHub.
WebReaper — scraping & extraction CLI
Three commands. Each is one shell call; output goes to stdout unless --output.
What to run
| The user wants… | Run |
|---|---|
| The readable text of one page | webreaper scrape <url> |
| The readable text saved to a file | webreaper scrape <url> --output page.md |
| Specific fields from one page | webreaper scrape <url> --schema schema.json |
| Every page of a whole site (Markdown) | webreaper crawl <url> > pages.jsonl |
| Every page of a whole site (fields) | webreaper crawl <url> --schema schema.json |
| Fields with no schema (LLM, per page) | webreaper scrape <url> --prompt "<what to extract>" --model <id> --llm-url <endpoint> |
| Whole site, fields, cheaply (LLM) | webreaper crawl <url> --infer "<goal>" --model <id> --llm-url <endpoint> |
| One file per page (instead of JSONL) | add --output-dir <dir> to scrape / crawl |
| URLs on a site | webreaper map <url> |
| URLs matching a substring | webreaper map <url> --search /blog/ --max-urls 50 |
| A JS-rendered page (SPA) | webreaper scrape <url> --browser |
| A bot-protected site | webreaper scrape <url> --browser --auto-stealth |
| Fields from every linked page | webreaper scrape <index-url> --follow "<css selector>" --schema schema.json |
Whole-site crawl in one command
To cover an entire site, use crawl: it recursively follows every on-domain
link from the start URL, extracts each page, and streams JSON Lines (one object
per page). Markdown by default; --schema switches to field extraction.
# Every page, as Markdown, to a file.
webreaper crawl https://example.com > pages.jsonl
# Every page, specific fields, bounded.
webreaper crawl https://example.com --schema schema.json --max-pages 200
Flags: --max-pages <n> (default 1000), --max-depth <n> (hops from the start
URL; default unlimited), --include-subdomains (default: same host + www
only), --no-sitemap (skip sitemap seeding; recursive links only),
--schema / --output (as for scrape). On-domain only; off-domain links
are never followed. crawl starts at HTTP and auto-climbs to a browser on a
blocked page (when one is installed), so a bot-protected site is handled; it
does not render JS-only pages or use the stealth tier, so for a JS-rendered SPA
or a site that needs stealth, scrape the pages with scrape --browser /
scrape --stealth instead.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 8d ago First seen · 236 lines · 413 tokens per session scan C 7e10f638b806
webreaper is a skill published in the GitHub repository alex-on-ai/WebReaper (146 stars, last pushed 1mo ago), licensed MIT. It adds 413 tokens to every session and 3,028 once invoked, about $0.0021 per session on Opus 5. A static security scan graded it C with 2 findings (downloads and executes remote code, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
firecrawl-build
Integrate Firecrawl into application code whenever a product, agent, or workflow needs web data inside the app — web search, live search results, page scraping, structured extraction, or browser interaction. Use when building any feature that needs data from the web in code, even if the user does not mention Firecrawl…
firecrawl-build-scrape
Integrate Firecrawl /scrape into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.
firecrawl-build-interact
Integrate Firecrawl /interact into product code for dynamic pages and browser actions after scraping. Use when a feature needs clicks, form fills, pagination, authentication-aware flows, or other multi-step interactions that plain /scrape cannot complete.
crawl4ai-skill
A web crawler and scraper that searches with DuckDuckGo, fetches individual pages or whole sites, and returns clean Markdown intended for language models. It can also scrape pages that need JavaScript to display their content.
scrapling-official
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…
firecrawl-build-onboarding
Get Firecrawl credentials and SDK setup into a project. Use when an application needs FIRECRAWLAPIKEY, when an agent should add Firecrawl to .env, when the user wants to authenticate Firecrawl for app code, or when choosing the first SDK and docs for a new Firecrawl integration. This skill includes its own browser…