scraping skills

68 tagged scraping, measured the same way as everything else here.

Browse within: apify 12data-extraction 12web 12playwright 7

scrapling-official

01

D4Vinci/Scrapling

Skill Claude CodeCodex

Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…

77k 6d ago A 80 tokens original BSD-3-Clause

ketch

02

1broseidon/ketch

Skill Claude CodeCodex

Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but the CLI is the primary interface. Use when a question needs live sources: 'research X', 'what are people saying about Y'…

526 5d ago A 148 tokens original MIT

TradingAi666/TzFilm-Douyin-Tool

Skill Claude CodeCodex

Scrape video stats from the Douyin creator center (creator.douyin.com) using AppleScript to automate the user's logged-in Chrome. Covers the data-center/content page. Use when setting up periodic data collection, building a Douyin stats tracker, or automating export of video performance data.

389 3mo ago A 68 tokens original MIT

browser-automation

04

librefang/librefang

Skill Claude CodeCodex

Playwright-based browser automation patterns for autonomous web interaction.

364 yesterday A 14 tokens original MIT

agent-browser

05

tashfeenahmed/circlechat

Skill Claude CodeCodex

Drive a real headless Chromium on the workspace host to read pages, fill forms, click buttons, run JS, and take screenshots. Use this whenever you need more than a plain HTTP fetch — pages that require JS to render, pages with an interactive element you have to click through, or when you want an accessibility-tree…

55 7d ago A 101 tokens original MIT

unbrowser

06

protostatis/unbrowser

Skill Claude CodeCodex

Cheap first-pass web discovery without launching Chrome — fetch SSR pages, run bounded JS, find routes/forms/API endpoints, extract structured data, and detect bot-wall or browser-only escalation points.

15 10d ago A 40 tokens original Apache-2.0

web-scraping

07

AstraBert/scpr

Skill Claude CodeCodex

Scrape web pages based on a provided URL using the scpr CLI app.

11 5mo ago A 21 tokens original MIT

scraperapi/scraperapi-skills

Skill Claude CodeCodex

Market research powered by live web data. Use this skill when the user wants to understand a market, category, or customer segment — including consumer sentiment, demand and trend signals, price and category structure, or the competitive landscape. Trigger on requests like "research the [X] market," "what do customers…

10 24d ago A 119 tokens original MIT

scraperapi-n8n

09

scraperapi/scraperapi-skills

Skill Claude CodeCodex

Generate n8n workflows that use the official ScraperAPI community node (n8n-nodes-scraperapi-official). Use this skill whenever the user wants to build, design, automate, or scaffold an n8n workflow that scrapes the web through ScraperAPI — even when they don't say "skill" or "ScraperAPI node" by name. Triggers…

10 24d ago A 279 tokens original MIT

scraperapi/scraperapi-skills

Skill Claude CodeCodex

Run a comprehensive SEO audit using ScraperAPI's live SERP and scraping tools — no setup required. Use this skill whenever the user wants to: audit SEO for a website, understand why a page isn't ranking, check SEO health, analyze keyword rankings, compare against competitors in search results, find content gaps…

10 24d ago A 196 tokens original MIT

itgoyo/binance-square

Skill Claude CodeCodex

A browser-based scraper for Binance Square, Binance’s social feed for market discussions. It collects trending topics, highly discussed posts, and frequently searched coins into an HTML report with clickable links.

5 4mo ago A 49 tokens

novada-proxy

12

NovadaLabs/novada-proxy

Skill Claude CodeCodex

Residential proxy tools for AI agents — fetch, crawl, search, extract, render through 2M+ IPs. Bypass anti-bot, geo-target 195+ countries. Use when: scraping websites, researching topics, extracting structured data, or any task that needs web access through a proxy.

4 2mo ago A 66 tokens original MIT

anti-bot-scraping

13

thirdwatch-dev/scraping-skills

Skill Claude CodeCodex

Use when a site blocks your scraper and you need to get past it — 403 Forbidden on the first request, JS challenges, CAPTCHAs, Cloudflare Turnstile, DataDome, Akamai, PerimeterX, "Just a moment...", access denied, IP bans, or an empty/skeleton page where data should be. Covers diagnosing transient failures vs real…

3 2mo ago A 216 tokens original MIT

apify-actor-builder

14

thirdwatch-dev/scraping-skills

Skill Claude CodeCodex

Use when you want to package a web scraper as a deployable, monetizable Apify Actor in Python — set up the directory structure, choose a runtime pattern (HTTP / impit / Playwright / Camoufox), write the input/output/dataset schemas, deploy with the apify CLI, and configure pay-per-event pricing. Triggers on "build an…

3 2mo ago A 122 tokens original MIT

job-market-scraping

15

thirdwatch-dev/scraping-skills

Skill Claude CodeCodex

Use when scraping the job market — job listings, salaries, company ratings, or candidate/profile sourcing — from LinkedIn, Indeed, Glassdoor, Naukri, Google Jobs, RemoteOK, Wellfound, Monster, ZipRecruiter, Reed, Adzuna, Upwork, CutShort, or AmbitionBox. Covers building a job aggregator, salary benchmarking…

3 2mo ago A 132 tokens original MIT

seo-pipeline-bash

16

attaxr/attaxr-seo-pipeline

Skill Claude CodeCodex

One-shot SEO content pipeline: scrape keywords from SERP and produce article markdown files via Browser Use SDK or DuckDuckGo fallback.

2 2mo ago A 32 tokens original MIT

thinkbrowse-cli

18

dundas/thinkrun

Skill Claude CodeCodex

Control browsers via the ThinkBrowse CLI (the thinkbrowse / thinkrun command) — navigate pages, interact with elements, extract content, take screenshots. Use ONLY when the user explicitly names the thinkbrowse or thinkrun CLI, or asks to drive the browser from shell scripts / terminal commands. For general browse…

1 1mo ago A 98 tokens original MIT