firecrawl-crawl

firecrawl-crawl is a skill for Claude Code from RudraDudhat2509/claude-skills. It costs 89 tokens per session (613 once invoked), scanned A, original, MIT.

A bulk website extractor that follows links to collect content from many pages. It can crawl an entire site or limit the crawl to a section such as documentation.

In plain words
What is it for?
Use it to extract all pages in a documentation section, collect content from a site, or follow links through a selected part of a website.
Why use it?
It removes the need to open and copy pages one at a time. Limits for page count, link depth, paths, delays, and parallel workers help control what gets collected.

Skill for Claude Code

Written for Claude Code: allowed-tools in frontmatter.

Good fit Use it to extract all pages in a documentation section, collect content from a site, or follow links through a selected part of a website.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/rudradudhat2509/claude-skills/firecrawl-crawl
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add RudraDudhat2509/claude-skills --skill firecrawl-crawl
Clone the repo
git clone --depth 1 https://github.com/RudraDudhat2509/claude-skills

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for firecrawl-crawl

README.md
[![agentmods](https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl/github.svg)](https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl)
Your own site
<a href="https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl"><img src="https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for firecrawl-crawl

Your own site · 80×15
<a href="https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl"><img src="https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 89 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 613 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00089 $0.00613
Opus 5.5 $0.00036 $0.00245
Sonnet 5.5 $0.00018 $0.00123
Haiku 4.5 $0.00009 $0.00061

Measured 1mo ago against content hash a5ddaae261c6, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

firecrawl-crawl scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

firecrawl-crawl/SKILL.md · 59 lines

How it starts

The opening of the file, as written. The whole thing — 59 lines — stays where its author put it; the contents beside it link to each section on GitHub.

firecrawl crawl

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

When to use

  • You need content from many pages on a site (e.g., all /docs/)
  • You want to extract an entire site section
  • Step 4 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

# Check status of a running crawl
firecrawl crawl <job-id>

Options

Option Description
--wait Wait for crawl to complete before returning
--progress Show progress while waiting
--limit <n> Max pages to crawl
--max-depth <n> Max link depth to follow
--include-paths <paths> Only crawl URLs matching these paths
--exclude-paths <paths> Skip URLs matching these paths
--delay <ms> Delay between requests
--max-concurrency <n> Max parallel crawl workers
--pretty Pretty print JSON output
-o, --output <path> Output file path

Tips

  • Always use --wait when you need the results immediately. Without it, crawl returns a job ID for async polling.
  • Use --include-paths to scope the crawl — don't crawl an entire site when you only need one section.
  • Crawl consumes credits per page. Check firecrawl credit-usage before large crawls.

See also

Read the full file on GitHub · 59 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 59 lines · 89 tokens per session scan A a5ddaae261c6

Subscribe to this mod's changes

firecrawl-crawl is a skill published in the GitHub repository RudraDudhat2509/claude-skills (2 stars, last pushed 2mo ago), licensed MIT. It adds 89 tokens to every session and 613 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.