crawl4ai-crawl

crawl4ai-crawl is an agent for Claude Code from romek-rozen/cc-crawl4ai. It costs 25 tokens per session (199 once invoked), scanned A, original, MIT.

A website-crawling agent that visits a limited number of pages using breadth-first, depth-first, or relevance-based navigation. Crawl4AI is a tool for collecting web pages in formats such as Markdown.

In plain words
What is it for?
Use it to map a site broadly, follow one section in depth, or prioritize pages likely to be relevant, then review the saved crawl results.
Why use it?
It helps you inspect several related pages while keeping the crawl bounded, so the process does not run through an entire site unexpectedly.

Agent for Claude Code

Written for Claude Code: ${CLAUDE_PLUGIN_ROOT} variable. Also seen: model in frontmatter.

Runs only inside its plugin — its command needs a path that Claude Code sets for a plugin’s own hooks and for nothing else. Install the plugin, not this.

Part of the cc-crawl4ai plugin — 5 skills, 3 agents shipped together

Good fit Use it to map a site broadly, follow one section in depth, or prioritize pages likely to be relevant, then review the saved crawl results.

Compare 6 agents from other repositories ↓
Install

Getting it into your agent

This one installs as part of its plugin. Adding the marketplace and installing the plugin brings it with everything else the plugin ships.

Claude Code
/plugin marketplace add romek-rozen/cc-crawl4ai
Claude Code
/plugin install cc-crawl4ai

Made for: Claude Code.

Or install cc-crawl4ai, the plugin that ships this one along with the rest of its 5 skills, 3 agents.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for crawl4ai-crawl

README.md
[![agentmods](https://agentmods.dev/badge/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl/github.svg)](https://agentmods.dev/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl)
Your own site
<a href="https://agentmods.dev/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl"><img src="https://agentmods.dev/badge/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for crawl4ai-crawl

Your own site · 80×15
<a href="https://agentmods.dev/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl"><img src="https://agentmods.dev/badge/agents/romek-rozen/cc-crawl4ai/crawl4ai-crawl.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 25 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 199 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00025 $0.00199
Opus 5 $0.00013 $0.00100
Sonnet 5 $0.00005 $0.00040
Haiku 4.5 $0.00003 $0.00020

Measured 9d ago against content hash 0d9475922b99, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

crawl4ai-crawl scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/cc-crawl4ai/agents/crawl4ai-crawl.md · 15 lines

What it actually says

Deep-crawl a live site with the bundled CLI. Always use --deep-crawl and a conservative explicit --max-pages (normally 5-10):

"${CLAUDE_PLUGIN_ROOT}/bin/crawl4ai" crawl "URL" --project-root "${CLAUDE_PROJECT_DIR}" --runtime-root "${CLAUDE_PLUGIN_DATA}" --deep-crawl bfs --max-pages 10 --output-format markdown

Use BFS for breadth, DFS for a branch, and best-first for relevance. Do not combine deep crawl with Trafilatura, BM25, question mode, or structured extraction. Read the saved artifact and return start URL, traversal, page cap, artifact path, pages found, and concise cross-page findings. Never guess content.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 15 lines · 25 tokens per session scan A 0d9475922b99

Subscribe to this mod's changes

crawl4ai-crawl is an agent published in the GitHub repository romek-rozen/cc-crawl4ai (12 stars, last pushed 28d ago), licensed MIT. It adds 25 tokens to every session and 199 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories

reviewer

Code review agent. Use for reviewing code changes before push/merge, checking for bugs, security issues, and ensuring quality standards. Mandatory before any push.

randomittin/heimdall · 34 tokens

verifier

Post-execution verification agent. Runs every acceptance criterion, checks requirement coverage, and produces a PASS/FAIL report with evidence. Never skips a criterion.

randomittin/heimdall · 33 tokens

architect

Technical architect. MUST BE USED for system design, API design, implementation planning, multi-file refactoring, and agent orchestration. Receives proposal.md from analyst and produces design.md + tasks.md.

komluk/scaffolding · 42 tokens

optimizer

Performance specialist. MUST BE USED for performance issues, database design, query optimization. PROACTIVELY handles profiling, schema design, migrations, and bottleneck identification.

komluk/scaffolding · 35 tokens

coder

Feature implementation specialist. Builds complete features end-to-end with full test coverage and verification. Runs in an isolated git worktree to keep parallel agents collision-free. Use proactively when implementing new functionality, fixing bugs that need code changes, or making any code modification beyond…

randomittin/heimdall · 57 tokens

web-crawler

Web documentation crawler that recursively follows links on API documentation sites to collect all endpoint content. Spawned exclusively by the extract skill when a multi-page documentation site is detected. Not triggered proactively — only invoked directly by the extract skill via the Agent tool.

hesedcasa/sdkck · 53 tokens