firecrawl-crawl

firecrawl-crawl is a skill for Claude Code from RudraDudhat2509/claude-skills. It costs 89 tokens per session (613 once invoked), scanned A, original, MIT.

A bulk website extractor that follows links to collect content from many pages. It can crawl an entire site or limit the crawl to a section such as documentation.

In plain words
What is it for?
Use it to extract all pages in a documentation section, collect content from a site, or follow links through a selected part of a website.
Why use it?
It removes the need to open and copy pages one at a time. Limits for page count, link depth, paths, delays, and parallel workers help control what gets collected.

Skill for Claude Code

Written for Claude Code: allowed-tools in frontmatter.

Good fit Use it to extract all pages in a documentation section, collect content from a site, or follow links through a selected part of a website.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/rudradudhat2509/claude-skills/firecrawl-crawl
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add RudraDudhat2509/claude-skills --skill firecrawl-crawl
Clone the repo
git clone --depth 1 https://github.com/RudraDudhat2509/claude-skills

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for firecrawl-crawl

README.md
[![agentmods](https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl/github.svg)](https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl)
Your own site
<a href="https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl"><img src="https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for firecrawl-crawl

Your own site · 80×15
<a href="https://agentmods.dev/skills/rudradudhat2509/claude-skills/firecrawl-crawl"><img src="https://agentmods.dev/badge/skills/rudradudhat2509/claude-skills/firecrawl-crawl.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 89 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 613 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00089 $0.00613
Opus 5 $0.00044 $0.00307
Sonnet 5 $0.00018 $0.00123
Haiku 4.5 $0.00009 $0.00061

Measured 12d ago against content hash a5ddaae261c6, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

firecrawl-crawl scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

firecrawl-crawl/SKILL.md · 59 lines

How it starts

The opening of the file, as written. The whole thing — 59 lines — stays where its author put it; the contents beside it link to each section on GitHub.

firecrawl crawl

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

When to use

  • You need content from many pages on a site (e.g., all /docs/)
  • You want to extract an entire site section
  • Step 4 in the workflow escalation pattern: search → scrape → map → crawl → interact

Quick start

# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

# Check status of a running crawl
firecrawl crawl <job-id>

Options

Option Description
--wait Wait for crawl to complete before returning
--progress Show progress while waiting
--limit <n> Max pages to crawl
--max-depth <n> Max link depth to follow
--include-paths <paths> Only crawl URLs matching these paths
--exclude-paths <paths> Skip URLs matching these paths
--delay <ms> Delay between requests
--max-concurrency <n> Max parallel crawl workers
--pretty Pretty print JSON output
-o, --output <path> Output file path

Tips

  • Always use --wait when you need the results immediately. Without it, crawl returns a job ID for async polling.
  • Use --include-paths to scope the crawl — don't crawl an entire site when you only need one section.
  • Crawl consumes credits per page. Check firecrawl credit-usage before large crawls.

See also

Read the full file on GitHub · 59 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 59 lines · 89 tokens per session scan A a5ddaae261c6

Subscribe to this mod's changes

firecrawl-crawl is a skill published in the GitHub repository RudraDudhat2509/claude-skills (2 stars, last pushed 19d ago), licensed MIT. It adds 89 tokens to every session and 613 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

agentcookie-install

Install agentcookie on a Mac source and a Linux or Mac sink so Chrome cookies sync continuously over Tailscale. Use when the user says "install agentcookie", "set up cookie sync", "share my Chrome sessions with my agent box", or "make my agent log in as me".

mvanhorn/agentcookie · 63 tokens

tauri-mcp-cli

Use the Tauri MCP CLI to start and recover driver sessions, automate Tauri webviews, capture UI state, debug IPC, and work with mobile or remote devices. Use whenever an agent needs to operate a Tauri v2 app from terminal commands.

hypothesi/mcp-server-tauri · 57 tokens

browser-automation

A browser-automation workflow that detects the terminal environment and chooses a browser control tool. It supports opening pages, taking snapshots, clicking, filling fields, and other checks.

Insajin/autopus-adk · 34 tokens

playwright-cli

Skill "playwright-cli" from Insajin/autopus-adk, covering browser automation with playwright-cli, quick start, commands, core and navigation.

Insajin/autopus-adk · 32 tokens

goofish-overview

An overview and entry point for goofish-cli, a tool package for helping an AI agent operate Xianyu, a Chinese second-hand marketplace. It covers account checks, listing items, buyer messages, risk checks, and shop diagnosis, and directs specific jobs to dedicated workflows.

fancyboi999/goofish-cli · 143 tokens

scout-web-access

Strato web-access cross-provider per gli Scout (F-2). 5 componenti coordinati — anti-bot robust scrape, LinkedIn session + search, email IMAP poll, multi-Scout workspace claim, freshness focus. Usato come stack base per ogni sweep: lo Scout sceglie il livello di accesso più leggero che funziona, e sale solo quando…

leopu00/job-hunter-team · 86 tokens