web-scraping skills

51 tagged web-scraping, measured the same way as everything else here.

Browse within: api-discovery 11browser-automation 9codex-skill 8data-engineering 8feasibility-analysis 8

google-maps-scraper

01

gosom/google-maps-scraper

Skill Claude CodeCodex

Find businesses, leads, emails, reviews, ratings, and contact details from Google Maps. Use for requests such as "find dentists in Berlin", "scrape Google Maps", "get local business leads", or "collect Google Maps reviews". Runs the open-source scraper locally with Docker and guides nontechnical users through setup…

5.7k +32 10d ago A 76 tokens original MIT

joeseesun/qiaomu-opencli-skills

Skill Claude CodeCodex

A guide for creating OpenCLI adapters for websites. An adapter is code that lets a command-line tool communicate with a particular website’s interfaces and data.

984 4mo ago A 83 tokens original MIT

neo

03

4ier/neo

Skill Claude CodeCodex

Browse websites, read web pages, interact with web apps, call website APIs, and automate web tasks. Use Neo when: user asks to check a website, read a web page, post on social media (Twitter/X), interact with any web app, look up information on a specific site, scrape data from websites, automate browser tasks, or…

751 +1 4mo ago A 122 tokens

ketch

04

1broseidon/ketch

Skill Claude CodeCodex

Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but the CLI is the primary interface. Use when a question needs live sources: 'research X', 'what are people saying about Y'…

526 5d ago A 148 tokens original MIT

web-browsing-cli

05

only-cli/oc

Skill Claude CodeCodex

Token-efficient web browsing and web content extraction for AI agents. Use when reading a URL, browsing websites, checking links, extracting static page content, or replacing raw HTML and browser screenshots.

411 6d ago A 43 tokens original MIT

opencli-explorer

06

zxfccmm4/Obsidian-OpenCode-Knowledge

Skill Claude CodeCodex

Use when creating a new OpenCLI adapter from scratch, adding support for a new website or platform, exploring a site's API endpoints via browser DevTools, or when a user asks to automatically generate a CLI for a website. Covers automated generation, API discovery workflow, authentication strategy selection, TS…

291 2mo ago A 68 tokens original MIT

opensteer

07

steerlabs/opensteer

Skill Claude CodeCodex

Direct browser control via CDP. Use when the user wants to automate, inspect, scrape, test, or interact with web pages.

202 1mo ago A 31 tokens original MIT

greekr4/playwright-bot-bypass

Skill Claude CodeCodex

This skill should be used when the user asks to "bypass bot detection", "avoid CAPTCHA", "stealth browser automation", "undetected playwright", "bypass Google bot check", "rebrowser-playwright", or needs to automate websites that detect and block bots.

192 +1 6d ago A 62 tokens original MIT

servo-fetch

09

konippi/servo-fetch

Skill Claude CodeCodex

Fetch and render web pages using the Servo browser engine — a single binary with JS execution, CSS layout, screenshots, and content extraction. Use when a URL returns empty or incomplete content with plain HTTP fetch, when you need a screenshot without GPU, or when you need to run JavaScript in a page context. No…

139 3d ago A 70 tokens original Apache-2.0

website-explorer

10

EndymionLee/PilotBrowseMCP

Skill Claude CodeCodex

Discover website capabilities from user behaviors. Learn APIs and automate workflows.

100 +3 1mo ago A 17 tokens original MIT

website-explorer

11

EndymionLee/PilotBrowseMCP

Skill Claude CodeCodex

A guide for exploring websites through user actions, discovering their APIs, and documenting reusable automation procedures. It stores findings as structured manuals covering pages, navigation, workflows, and API endpoints.

100 +3 1mo ago A 21 tokens original MIT

website-explorer

12

EndymionLee/PilotBrowseMCP

Skill Claude CodeCodex

Discover website capabilities from user behaviors. Learn APIs and automate workflows.

100 +3 1mo ago A 17 tokens copy · 100% MIT

docpull-research

13

raintree-technology/docpull

Skill Claude CodeCodex

Use the docpull MCP tools (listindexed, ensuredocs, grepdocs, readdoc, fetchurl) to ground answers in real web/source material when the user asks about a specific library, framework, API, vendor, product page, website, or public source URL. Activate on questions like "how do I X in [library]", "what's the API for…

25 6d ago A 115 tokens original MIT

CBrowser

14

alexandriashai/cbrowser

Skill Claude CodeCodex

Cognitive Browser — AI browser automation that simulates real user cognition. 122 MCP tools, 21 personas, 25 cognitive traits, constitutional safety, cognitive journeys with LLM-free trace replay, screen capture to GIF/WebP/WebM with an AI-readable frame manifest (v18.69.3). USE WHEN browser automation OR cognitive…

19 18d ago A 142 tokens

crawl4ai-skill

15

lancelin111/crawl4ai-skill

Skill Claude CodeCodex

A web crawler and scraper that searches with DuckDuckGo, fetches individual pages or whole sites, and returns clean Markdown intended for language models. It can also scrape pages that need JavaScript to display their content.

16 5mo ago A 63 tokens original MIT

JS Reverse Analyzer

16

sjhhh024-cmyk/Spider-JS-Mcp-Skills

Skill Claude CodeCodex

A general-purpose guide for examining JavaScript code to identify website encryption, request signatures, and anti-bot checks, then documenting the findings in Python.

10 7mo ago A 37 tokens original Apache-2.0

OpenAnalystInc/10x-Research-Skill

Skill Claude CodeCodex

Interactive content research, curation, and personalization workflow for Team 10x.in. Use when Codex needs to turn research into blogs, emails, social posts, landing pages, or newsletters. For multi-source autonomous research, dynamic browsing, or MCP-first evidence gathering, pair this skill with…

3 4mo ago A 71 tokens

image-generation

18

OpenAnalystInc/10x-Research-Skill

Skill Claude CodeCodex

Interactive AI image generation using Google Gemini. ALWAYS ask the user clarifying questions before generating any image. Never assume - always prompt for specifics about subject, style, platform, colors, mood, and dimensions.

3 4mo ago A 44 tokens

web-scraper

19

OpenAnalystInc/10x-Research-Skill

Skill Claude CodeCodex

Interactive web scraping skill for Team 10x.in workflows. Use when Codex needs local copies of website assets or wants a script-based fallback to MCP crawling. For site discovery, structured extraction, or dynamic-page browsing, pair this skill with autonomous-research-system so Tavily, Firecrawl, and Playwright can…

3 4mo ago A 75 tokens

novada-agent

20

NovadaLabs/Novada-mcp

Skill Claude CodeCodex

Use Novada MCP tools for web tasks. Covers tool selection (search vs extract vs crawl vs map vs research), key parameters, common workflows, and when NOT to call each tool. Trigger: any task requiring web data, content extraction, site crawling, or multi-source research.

3 4d ago A 60 tokens

novada-proxy

21

NovadaLabs/Novada-mcp

Skill Claude CodeCodex

Choose the right Novada proxy type, format, and targeting options. Covers the 6 proxy types (residential/isp/mobile/datacenter/static/dedicated), when each applies, critical constraints per type, the escalation ladder, and when NOT to use proxy tools at all. Trigger: any task requiring geo-targeted HTTP requests, IP…

3 4d ago A 88 tokens

novada-scrape

22

NovadaLabs/Novada-mcp

Skill Claude CodeCodex

When to use: You need structured records from a known platform (Amazon, TikTok, LinkedIn, GitHub, etc.) — not raw HTML, but clean tabular data. 16 platforms are in the catalog: Amazon, Walmart, SHEIN, Google (incl. Shopping), Bing, DuckDuckGo, Yandex, X/Twitter, TikTok, Instagram, Facebook, YouTube, LinkedIn, GitHub…

3 4d ago A 0 tokens

ares

23

AndreaBozzo/Ares-Claude-Skill

Skill Claude CodeCodex

Use when working with the Ares web scraper — an LLM-powered Rust tool that extracts structured data from websites using JSON Schemas. Covers library usage, CLI commands, REST API, schema creation, adding custom fetchers/cleaners/extractors, deployment, and contributing to the Ares codebase.

2 2mo ago A 64 tokens

Pranjay-kumar/universal-data-acquisition-pipeline-skill

Skill Claude CodeCodex

Trigger when the user wants to collect, structure, evaluate, crawl, extract, refresh, or build reusable data acquisition pipelines from websites, APIs, portals, files, or rendered apps. Use for dataset design, source classification, feasibility, endpoint discovery, authorized/owned-session scraping plans, Patchright…

2 2mo ago A 126 tokens original MIT