openclaw-web-scraper

openclaw-web-scraper is a skill for Claude Code, Codex from yedanyagamiai-cmd/openclaw-mcp-servers. It costs 131 tokens per session (2,548 once invoked), scanned A, original, MIT.

A web-scraping MCP server that fetches pages, extracts structured information, takes screenshots, interacts with pages, and processes URL batches.

In plain words
What is it for?
Use it to scrape pages, extract fields with selectors or plain-language instructions, capture screenshots, click or fill page elements, and process multiple URLs.
Why use it?
It removes the need to manually copy information from websites or write separate browser-automation code for common extraction tasks.

Skill for Claude CodeCodex

Which agent this was written for is unclear — built for openclaw. Also seen: positional $N argument; built for openclaw.

Good fit Use it to scrape pages, extract fields with selectors or plain-language instructions, capture screenshots, click or fill page elements, and process multiple URLs.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add yedanyagamiai-cmd/openclaw-mcp-servers --skill openclaw-web-scraper
Clone the repo
git clone --depth 1 https://github.com/yedanyagamiai-cmd/openclaw-mcp-servers

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for openclaw-web-scraper

README.md
[![agentmods](https://agentmods.dev/badge/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper/github.svg)](https://agentmods.dev/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper)
Your own site
<a href="https://agentmods.dev/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper"><img src="https://agentmods.dev/badge/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for openclaw-web-scraper

Your own site · 80×15
<a href="https://agentmods.dev/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper"><img src="https://agentmods.dev/badge/skills/yedanyagamiai-cmd/openclaw-mcp-servers/openclaw-web-scraper.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 131 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,548 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00131 $0.02548
Opus 5 $0.00066 $0.01274
Sonnet 5 $0.00026 $0.00510
Haiku 4.5 $0.00013 $0.00255

Measured 12d ago against content hash dda59d2e1b8d, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

openclaw-web-scraper scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

clawhub-skills/openclaw-web-scraper/SKILL.md · 204 lines

How it starts

The opening of the file, as written. The whole thing — 204 lines — stays where its author put it; the contents beside it link to each section on GitHub.

OpenClaw Web Scraper v2.0

Stealth web scraping with anti-detection and structured extraction. 5 tools. Real browser. Cloudflare bypass. Batch support.

Tool Purpose Free
scrape_url Fetch full page content with stealth headers and JS rendering Yes
extract_data Extract structured data using CSS selectors or natural language Yes
screenshot_page Capture full-page or viewport screenshot of any URL Yes
interact_with_page Click buttons, fill forms, scroll, wait for elements Pro
batch_scrape Scrape up to 50 URLs in parallel with rate limiting Pro

What's New in v2.0

  • StealthCrawl Engine -- Rotating User-Agents, real browser fingerprints, and Cloudflare bypass using the openclaw-browser CF Worker. Detected <5% of the time on major sites.
  • NLP Extraction -- Pass a natural language instruction instead of a CSS selector: "extract all product names and prices" → structured JSON. No selector knowledge required.
  • SmartThrottle -- Automatic rate limiting per domain. Respects robots.txt by default. Never gets your IP banned.
  • SessionPersist -- Pro users can maintain cookies and session state across multiple interact_with_page calls. Log in once, scrape authenticated pages all session.

Quick Start

{
  "openclaw-web-scraper": {
    "type": "streamable-http",
    "url": "https://openclaw-web-scraper-mcp.yagami8095.workers.dev/mcp"
  }
}

Add to Claude Desktop, Cursor, Windsurf, VS Code, or any MCP-compatible client. Zero install. Works immediately.

Detection Triggers

This skill activates when a user says any of these:

  • "scrape this URL", "extract data from this site", "get the content of", "crawl this page"
  • "get all prices", "extract all links", "parse this table", "pull product list from"
  • "screenshot this page", "capture this URL", "take a snapshot", "page screenshot"
  • "click the login button", "fill out this form", "interact with", "click and get result"
  • "scrape 20 URLs", "batch scrape", "bulk extract", "crawl multiple pages"
  • "get around Cloudflare", "bypass bot detection", "stealth scrape", "headless browser"

Read the full file on GitHub · 204 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 204 lines · 131 tokens per session scan A dda59d2e1b8d

Subscribe to this mod's changes

openclaw-web-scraper is a skill published in the GitHub repository yedanyagamiai-cmd/openclaw-mcp-servers (3 stars, last pushed 5mo ago), licensed MIT. It adds 131 tokens to every session and 2,548 once invoked, about $0.0007 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

@elad12390/web-research-assistant

Comprehensive MCP server for web research with 14 tools: SearXNG + Exa AI search, URL crawling, stealth scraping (Cloudflare bypass), package registry lookup (npm/PyPI/crates), GitHub stats, changelog fetching, tech comparison, error translation, API docs discovery, stock image search, and service health. Trigger…

elad12390/web-research-assistant · 144 tokens

check-pricing-changes

Check recent developer tool pricing changes, free tier removals, and new deals.

robhunter/agentdeals · 21 tokens

search-deals

Search for free tiers, startup credits, and developer tool deals.

robhunter/agentdeals · 16 tokens

glim

Live data for AI agents - Twitter/X search, Reddit posts and comments, semantic web search, clean page extraction, GitHub repos/code/PRs, Amazon products, YouTube transcripts, public Telegram channels, AI-text detection. One hosted MCP server at glim.sh/mcp. Sign in with OAuth and a prepaid balance, or pay per call…

glim-sh/glim-mcp · 95 tokens

delegacion-local

Regla y catálogo para delegar pasos mecánicos (resumir, clasificar, extraer, boilerplate, mensaje de commit desde un diff, traducir texto o archivo, resumir salida de lint/tests/CI, explicar código, describir una imagen, verificar si el backend local está disponible) a modelos locales vía las tools local del MCP…

ZahiriNatZuke/local-delegate · 137 tokens

class-management

Use when the user wants to create a new class, group, or course in Zooza — e.g. "set up a Monday yoga class", "add a new group", "schedule a course". Guides through programme selection, venue, trainer, session pattern, and commits.

zooza-dev/zooza-mcp-server · 56 tokens