197 tagged crawler, measured the same way as everything else here.
Browse within: Multi-Agent 58digital-employee 58makemoney 58mas 58multi-agent-systems 58audit 35core-web-vitals 35data-extraction 34browser-automation 28bun 28cdp 28curl-impersonate 28scraper 16docker 15
Skill Claude CodeCodex
Get Firecrawl credentials and SDK setup into a project. Use when an application needs FIRECRAWLAPIKEY, when an agent should add Firecrawl to .env, when the user wants to authenticate Firecrawl for app code, or when choosing the first SDK and docs for a new Firecrawl integration. This skill includes its own browser…
Skill Claude CodeCodex
Integrate Firecrawl /scrape into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.
Skill Claude CodeCodex
Integrate Firecrawl into application code whenever a product, agent, or workflow needs web data inside the app — web search, live search results, page scraping, structured extraction, or browser interaction. Use when building any feature that needs data from the web in code, even if the user does not mention Firecrawl…
Skill Claude CodeCodex
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…
Skill Claude CodeCodex
A video-production workflow for turning a short spoken script, statement, or abstract idea into editorial halftone paper-collage B-roll.
Skill Claude CodeCodex
A video-production tool for creating complete videos from scratch or editing existing clips. It can cover scripts, storyboards, matching footage, voiceovers, subtitles, assembly, rendering, and checks before delivery.
Skill Claude CodeCodex
A browser-automation tool for publishing posts on Twitter/X, including text, media, threads, quotes, replies, and long posts.
Skill Claude CodeCodex
Node.js web crawler for production-grade, large-scale tasks — NOT for simple one-off requests. Use only when: bulk scraping, batch downloading, multi-page crawling, long-running spiders, or complex multi-step workflows that need connection pooling, rate limiting, proxy rotation, automatic retries, and Cheerio parsing.…
eatmoreduck/boss-zhipin-scraper
Skill Claude CodeCodex
Scrape BOSS直聘 (job listing site) via Chrome CDP. Searches jobs by keyword/city/filters, fetches JD details, outputs structured JSON/CSV with plaintext salary, and can summarize scraped results into a job-market prompt. Use when user wants to search/analyze jobs on BOSS直聘 or zhipin.com.
Skill Claude CodeCodex
Scrape, crawl, map, and search the web using fastCRW's native /v1 API. Use when the user needs web page content, site-wide extraction, URL discovery, or web search results. Single binary, 14 MB RAM; /v2 exists separately for Firecrawl migration.
Skill Claude CodeCodex
Reference skill for building production-ready crw integrations. Covers verb selection, call surfaces (CLI/MCP/REST), post-filtering strategies, context-window hygiene, Hybrid RAG patterns, common pitfalls, and crw-specific operational considerations (search backend limits, renderer pool, proxy rotation). Load this…
Skill Claude CodeCodex
Programmatic web search and scrape with context isolation. Use for any research task where you need to search the web, filter results, and extract specific information — without flooding your context window with raw HTML and boilerplate. This is the single biggest token-saver in the crw skill set. Triggered by "search…
Skill Claude CodeCodex
skills/ir-search/SKILL.md.
Skill Claude CodeCodex
Compact the current conversation into a handoff document for another agent to pick up.
Skill Claude CodeCodex
Triage issues through a state machine driven by triage roles. Use when user wants to create an issue, triage issues, review incoming bugs or feature requests, prepare issues for an AFK agent, or manage issue workflow.
Skill Claude CodeCodex
Scrape, crawl, or extract structured data from one or more URLs via the webreaper CLI. Outputs clean Markdown by default; JSON when a schema is given, or schema-free JSON when an LLM endpoint is configured (extract by natural-language prompt, no CSS selectors). Maps a site's URLs in one call. Handles JS-rendered pages…
Skill Claude CodeCodex
Find and fix broken links, dead pages, and redirect chains on a website with crawlie. Use when the user asks to find broken links, 404s, dead links, link rot, redirect chains/loops, or 4xx/5xx pages, or to check that a site's links are healthy. Works even if crawlie is not installed.
Skill Claude CodeCodex
Assess how ready a website is to be cited and answered by AI search and LLMs (Generative Engine Optimization / GEO) using crawlie. Use when the user asks about AI search, generative engine optimization, GEO, getting cited by ChatGPT / Perplexity / Google AI Overviews, llms.txt, structured data for AI, or whether their…
Skill Claude CodeCodex
Run a complete technical SEO + AI-search audit of a website with crawlie. Use when the user asks to audit, crawl, or check a site for SEO issues, broken links, redirects, missing titles/descriptions/metadata, canonical or heading problems, image alt text, duplicate or thin content, or generative-engine (GEO /…
Skill Claude CodeCodex
Extract API endpoints from the active ClaudeChrome browser tab and save them as local artifacts. Use when the user asks to find, capture, reverse engineer, document, or generate Python scripts for endpoints used by the current tab, this page, a live website, or a user-specified browser interaction in ClaudeChrome.
Skill Claude CodeCodex
Query Weibo users, posts, and comments through the local crawl4weibo CLI. Use when the workspace contains this repository and the user wants deterministic shell access to the project's Weibo crawling capabilities from OpenClaw.
Skill Claude CodeCodex
Use when user asks to scan a target for exposed JavaScript secrets, run a jsrip scan, analyze findings for true/false positives, or says /jsrip-scan. Single-target bug bounty recon — runs jsrip then auto-classifies every finding.
Skill Claude CodeCodex
Use when tracing browser requests, recovering JavaScript-generated request outputs, diagnosing anti-bot runtime gaps, or delivering independently verified scraping modules.
Skill Claude CodeCodex
Web crawling and scraping tool with LLM-optimized output. 网页爬虫爬取工具 | Web crawler, web scraper, spider. DuckDuckGo search, site crawling, dynamic page scraping. 智能搜索爬取 | Free, no API key required.