web crawling skills

3 tagged web crawling, measured the same way as everything else here.

crawl4ai-skill

01

lancelin111/crawl4ai-skill

Skill Claude CodeCodex

Web crawling and scraping tool with LLM-optimized output. 网页爬虫爬取工具 | Web crawler, web scraper, spider. DuckDuckGo search, site crawling, dynamic page scraping. 智能搜索爬取 | Free, no API key required.

16 5mo ago A 63 tokens original MIT

search1api

02

superagents-lab/search1api-cli

Skill Claude CodeCodex

Live web search, page retrieval, news, sitemap discovery, trending topics, and turning a URL into a reusable Agent Skill — all through Search1API. Use this skill whenever the user wants to search the web, look something up, research a topic, read or summarize a URL, check current news, explore a site's links, see…

2 8d ago C 209 tokens original MIT

web

03

hex/claude-crawl

Skill Claude CodeCodex

This skill should be used for any web content operation: fetching URLs, searching the web, scraping JavaScript-heavy pages, crawling multi-page sites, mapping site URLs, taking screenshots, rendering pages as PDF, extracting structured data, reranking search results, and fact-checking claims against live web sources.…

1 5mo ago A 150 tokens original MIT