4 tagged web-crawling, measured the same way as everything else here.
Skill Claude CodeCodex
A web crawler and scraper that searches with DuckDuckGo, fetches individual pages or whole sites, and returns clean Markdown intended for language models. It can also scrape pages that need JavaScript to display their content.
superagents-lab/search1api-cli
Skill Claude CodeCodex
Live web search, agentic search, page retrieval, news, sitemap discovery, trending topics, and turning a URL into a reusable Agent Skill — all through the Search1API CLI (s1). Use this skill whenever the user wants to search the web, look something up, research a topic, read or summarize a URL, check current news…