content-extraction commands

77 tagged content-extraction, measured the same way as everything else here.

Browse within: anycrawl 15claude-code-skills 15

firecrawl/firecrawl-mcp-server

MCP server Claude CodeCodexCursor +2

Lets the agent scrape, crawl and search the web through Firecrawl, returning clean markdown. Runs locally from the firecrawl-mcp npm package. Needs 1 environment variable to run.

7.4k +13 today A tokens not measured original MIT

teng-lin/agent-fetch

Instructions file

Instructions for teng-lin/agent-fetch, covering claude.md — agent-fetch, commands, before committing or creating a pr, worktree workflow and project structure.

307 +2 5mo ago A 1,096 tokens original MIT

agent-fetch

03

teng-lin/agent-fetch

Skill Claude CodeCodex

Fetch and extract full article content from URLs. Returns complete text with structure (headings, links, lists) instead of summaries. Multiple extraction strategies, browser impersonation, cookies, crawling, custom selectors, 200-700ms.

307 +2 5mo ago A 50 tokens original MIT

pinkpixel-dev/web-scout-mcp

MCP server Claude CodeCodexCursor +2

Search the web and extract clean, readable text from webpages. Process multiple URLs at once to sp… Remote server at server.smithery.ai.

132 1mo ago A tokens not measured original Apache-2.0

agent-skills

05

youdotcom-oss/agent-skills

Plugin Claude Code

You.com skills for search, contents, research, finance, and integration discovery with MCP, ARD, API-key, OAuth, and MPP/x402 payment guidance.

64 8d ago A tokens not measured original MIT

youdotcom-oss/agent-skills

Instructions file CodexOpenCode

Instructions for youdotcom-oss/agent-skills, covering agent instructions, tooling discovery, minimal-implementation directive, style enforcement and workflow.

64 8d ago A 1,092 tokens original MIT

youdotcom-oss/agent-skills

Instructions file

Instructions for youdotcom-oss/agent-skills, a project described as: You.com skills and plugins for web search, content extraction, research, finance, and integration discovery, helping AI agents build with up-to-date web context.

64 8d ago A 16 tokens original MIT

you-discover

08

youdotcom-oss/agent-skills

Skill Claude CodeCodex

Route You.com integration planning through the you-discover MCP tool, Docs MCP, and direct API options.

64 8d ago A 25 tokens original MIT

you-finance

09

youdotcom-oss/agent-skills

Skill Claude CodeCodex

Route finance questions to an existing local script, a new You.com Finance Research API call, or an MCP payment-aware fallback.

64 8d ago A 29 tokens original MIT

you-web

10

youdotcom-oss/agent-skills

Skill Claude CodeCodex

Use You.com MCP tools for current web search, URL content extraction, cited web synthesis, and x402-aware web access.

64 8d ago A 28 tokens original MIT

content-extract

11

blessonism/openclaw-skills

Skill Claude CodeCodex

Robust URL-to-Markdown extraction for OpenClaw workflows. Use when the user wants to "extract/summarize/convert a webpage to markdown" (especially WeChat mp.weixin.qq.com) and webfetch/browser is blocked or messy. Uses a cheap probe via webfetch first, then falls back to the official MinerU API (via the local…

55 5mo ago A 92 tokens original MIT

mineru-extract

12

blessonism/openclaw-skills

Skill Claude CodeCodex

Use the official MinerU (mineru.net) parsing API to convert a URL (HTML pages like WeChat articles, or direct PDF/Office/image links) into clean Markdown + structured outputs. Use when webfetch/browser can’t access or extracts messy content, and you want higher-fidelity parsing (layout/table/formula/OCR).

55 5mo ago A 72 tokens original MIT

search-layer

13

blessonism/openclaw-skills

Skill Claude CodeCodex

DEFAULT search tool for ALL search/lookup needs. Multi-source search and deduplication layer with intent-aware scoring. Integrates Brave Search (websearch), Exa, Tavily, and Grok to provide high-coverage, high-quality results. Automatically classifies query intent and adjusts search strategy, scoring weights, and…

55 5mo ago A 116 tokens original MIT

web-researcher-mcp

14

zoharbabin/web-researcher-mcp

Plugin Claude Code

Your AI research assistant that cites real sources and stays honest. Search the entire web or narrow it down to just the sites you trust; medical journals, court databases, news outlets, academic papers. Analyze the full source, not just snippets. Links that work, citations you can trust, no made up closed garden…

52 8d ago A tokens not measured original MIT

web-researcher

16

zoharbabin/web-researcher-mcp

MCP server Claude CodeCodexCursor +2

MCP server "web-researcher" as configured in zoharbabin/web-researcher-mcp. Launched with web-researcher-mcp. Needs 56 environment variables to run.

52 8d ago A tokens not measured original MIT

zoharbabin/web-researcher-mcp

Instructions file

Instructions for zoharbabin/web-researcher-mcp, covering claude.md — web-researcher-mcp, commands, contribution rules, architecture and non-obvious top-level dirs.

52 8d ago A 5,745 tokens original MIT

web-researcher-mcp

18

zoharbabin/web-researcher-mcp

MCP server Claude CodeCodexCursor +2

MCP server "web-researcher-mcp" as configured in zoharbabin/web-researcher-mcp. Runs in Docker (ghcr.io/zoharbabin/web-researcher-mcp:1.9.0). Needs 8 environment variables to run.

52 8d ago A tokens not measured original MIT

Vincentwei1021/agent-toolbox

Instructions file

Instructions for Vincentwei1021/agent-toolbox, covering claude.md — agent toolbox api, project overview, architecture, tech stack and build & run.

6 5mo ago A 1,180 tokens original MIT

argus AGENTS.md

21

Khamel83/argus

Instructions file CodexOpenCode

Instructions for Khamel83/argus, covering agents.md — argus, features, two deployment tiers, tier 1: no server (api keys only) and tier 2: full install on hardware you already have.

4 2d ago A 3,021 tokens original MIT

argus CLAUDE.md

22

Khamel83/argus

Instructions file

Instructions for Khamel83/argus, covering claude code — argus and claude-code-specific notes.

4 2d ago A 326 tokens original MIT

argus

23

Khamel83/argus

MCP server Claude CodeCodexCursor +2

Retrieval platform for AI agents — 14 search providers, 12-step content extraction, dead URL recovery, site capture, and local corpus storage. One API. Runs locally from the argus-search Python package. Needs 8 environment variables to run.

4 2d ago A tokens not measured original MIT

fetchv2-mcp-server

24

praveenc/fetchv2-mcp-server

MCP server Claude CodeCodexCursor +2

A robust MCP server for fetching and extracting web content using Trafilatura. Runs locally from the fetchv2-mcp-server Python package.

3 9mo ago A tokens not measured original MIT

At most 3 mods per repository are shown here — the rest are on their repository pages: