web-scraping skills

45 tagged web-scraping, measured the same way as everything else here.

Browse within: firecrawl 49web-search 48claude-code-skills 32cli 18api-discovery 11LLM 9browser-automation 9codex-skill 8data-engineering 8feasibility-analysis 8claude-code-plugin 7playwright 6markdown 5

google-maps-scraper

01

gosom/google-maps-scraper

Skill Claude Code

Find businesses, leads, emails, reviews, ratings, and contact details from Google Maps. Use for requests such as "find dentists in Berlin", "scrape Google Maps", "get local business leads", or "collect Google Maps reviews". Runs the open-source scraper locally with Docker and guides nontechnical users through setup…

not rated 6.5k +139 23d ago A Socket: passSnyk: passSkillSpector: warn 76 tokens original MIT

joeseesun/qiaomu-opencli-skills

Skill Claude CodeCodex needs its repo

A guide for creating OpenCLI adapters for websites. An adapter is code that lets a command-line tool communicate with a particular website’s interfaces and data.

not rated 996 +2 6mo ago A Socket: passSnyk: warnSkillSpector: warn 83 tokens original MIT

neo

03

4ier/neo

Skill Claude CodeCodex

Browse websites, read web pages, interact with web apps, call website APIs, and automate web tasks. Use Neo when: user asks to check a website, read a web page, post on social media (Twitter/X), interact with any web app, look up information on a specific site, scrape data from websites, automate browser tasks, or…

not rated 756 5mo ago A 122 tokens

ketch

04

1broseidon/ketch

Skill Claude CodeCodex

Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but the CLI is the primary interface. Use when a question needs live sources: 'research X', 'what are people saying about Y'…

not rated 716 +13 changed 7d ago A SkillSpector: pass 148 tokens original MIT

opensteer

05

steerlabs/opensteer

Skill Claude CodeCodex

Direct browser control via CDP. Use when the user wants to automate, inspect, scrape, test, or interact with web pages.

not rated 203 2mo ago A SkillSpector: pass 31 tokens original MIT

servo-fetch

06

konippi/servo-fetch

Skill Claude CodeCodex needs its repo

Fetch and render web pages using the Servo browser engine — a single binary with JS execution, CSS layout, screenshots, and content extraction. Use when a URL returns empty or incomplete content with plain HTTP fetch, when you need a screenshot without GPU, or when you need to run JavaScript in a page context. No…

not rated 160 +3 changed 24d ago A SkillSpector: warn 70 tokens original Apache-2.0

website-explorer

07

EndymionLee/PilotBrowseMCP

Skill Codex

Discover website capabilities from user behaviors. Learn APIs and automate workflows.

not rated 22 +83 2mo ago A SkillSpector: pass 17 tokens original MIT

CBrowser

08

alexandriashai/cbrowser

Skill Claude CodeCodex

Cognitive Browser — AI browser automation that simulates real user cognition. 122 MCP tools, 21 personas, 25 cognitive traits, constitutional safety, cognitive journeys with LLM-free trace replay, screen capture to GIF/WebP/WebM with an AI-readable frame manifest (v18.69.3). USE WHEN browser automation OR cognitive…

not rated 19 +1 4d ago A 142 tokens

crawl4ai-skill

09

lancelin111/crawl4ai-skill

Skill Claude CodeCodex

A web crawler and scraper that searches with DuckDuckGo, fetches individual pages or whole sites, and returns clean Markdown intended for language models. It can also scrape pages that need JavaScript to display their content.

not rated 16 7mo ago A 63 tokens original MIT

JS Reverse Analyzer

10

sjhhh024-cmyk/Spider-JS-Mcp-Skills

Skill Claude CodeCodex

A general-purpose guide for examining JavaScript code to identify website encryption, request signatures, and anti-bot checks, then documenting the findings in Python.

not rated 10 8mo ago A 37 tokens original Apache-2.0

ares

11

AndreaBozzo/Ares-Claude-Skill

Skill Claude CodeCodex

Use when working with the Ares web scraper — an LLM-powered Rust tool that extracts structured data from websites using JSON Schemas. Covers library usage, CLI commands, REST API, schema creation, adding custom fetchers/cleaners/extractors, deployment, and contributing to the Ares codebase.

not rated 2 3mo ago A 64 tokens

Pranjay-kumar/universal-data-acquisition-pipeline-skill

Skill Claude CodeCodex

Use for Patchright/Playwright-based public or authorized browser probing: warm-session cookie/storage generation, browser network capture, JSON/API route discovery from page loads, rendered DOM fallback, screenshots, tiny DOM samples, and user-owned storage-state workflows. Do not use for CAPTCHA solving, credential…

not rated 2 4mo ago A 72 tokens original MIT

retail-scrapers

13

Mrjie7205/retail-scrapers

Skill Codex

Assess, reuse, build, repair, and validate public retail catalog and price channels in the Retail Scrapers Python toolkit. Use when a user provides a retailer name or URL, asks whether an existing adapter or market configuration can handle it, requests a new channel, or needs an existing channel fixed after site drift.

not rated 2 2mo ago A 68 tokens original MIT

shantycrawl-mcp

14

schlemperdev/shantycrawl-mcp

Skill Claude CodeCodex

Use toolenable to activate lazy-loaded Firecrawl tools (map, extract, parse, agent, interact, research, monitor) before calling them.

not rated 1 3mo ago A 36 tokens original MIT

deep-research

15

SECRET4422/mcp-deep-research-server

Skill Claude CodeCodex

Orchestrate autonomous deep web research, parallel scraping, citation synthesis, fact checking, and persistent memory using the Deep Research MCP server. Use when asked to 'deep research', 'research this topic', 'fact check claim', 'compare sources', or perform comprehensive multi-source investigation with zero API…

not rated 1 3d ago A 64 tokens original MIT

spider-data

16

MirandaKim1434/spider-data

Skill Claude CodeCodex

Search the web, fetch a page, or crawl a site — via the spider-data CLI, which is backed by the spider.cloud API. Use this for ANY web access: looking something up online, reading a URL, checking documentation, researching a library or product, pulling an article, or gathering pages from a site. This REPLACES the…

not rated 0 2mo ago A 119 tokens original MIT

scrapling-official

17

ishanbhosale08/Valkyrie

Skill Claude CodeCodex

Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…

not rated 0 2mo ago A 80 tokens copy · 86% BSD-3-Clause

gatekeeper

18

rycerzes/brightdata-gatekeeper

Skill Claude CodeCodex

Use when a Bright Data Scraper Studio collector returns wrong, empty, or partial data and needs repairing — detect what broke, write a heal brief, and decide whether the proposed fix earns a commit. Also use before creating a custom collector, to check whether Bright Data already ships one. Triggers on "scraper…

not rated 0 1mo ago A 95 tokens

infinity-scraper

19

virajverse/infinity-scraper

Skill Claude CodeCodex

World-Class Autonomous AI Playbook & Cognitive Reasoning Framework for InfinityScrape MCP Suite. Enables any AI Agent to scrape web content with high-speed Singleton BrowserPool (1.8s), render dynamic SPAs with Playwright, bypass Cloudflare Turnstile, execute 3-tier multi-engine search failovers (Anti-429), crawl…

not rated 0 changed today A 136 tokens

nanoparse

20

nanoparse-dev/nanoparse-mcp

Skill Claude CodeCodex

Read any live web page as clean Markdown plus Litmus source-intelligence signals (source authority, freshness, structural trust, syndication, paywall) through the NanoParse MCP server. Use when an agent needs the content of a URL that is noisy, JavaScript-rendered, or behind a bot wall, or needs to judge whether a…

not rated 0 today A 156 tokens original MIT

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: