exa-crawl

exa-crawl is a command for Claude Code from thangnguyenworkspace/company-research-pipeline. It costs 23 tokens per session (497 once invoked), scanned A, original, MIT.

A command for fetching the contents of one or more web pages or PDFs through Exa, a web search and retrieval service.

In plain words
What is it for?
It helps crawl URLs in batches, save raw results to files, and retry failed or empty fetches through a cached-search fallback.
Why use it?
It preserves the retrieved material for later research and identifies whether each fetch was complete, partial, paywalled, or unsuccessful.

Command for Claude Code

Written for Claude Code: argument-hint in frontmatter.

Good fit It helps crawl URLs in batches, save raw results to files, and retry failed or empty fetches through a cached-search fallback.

Compare 6 commands from other repositories ↓
Install with agentmods
npx agentmods add commands/thangnguyenworkspace/company-research-pipeline/exa-crawl
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo
git clone --depth 1 https://github.com/thangnguyenworkspace/company-research-pipeline

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for exa-crawl

README.md
[![agentmods](https://agentmods.dev/badge/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl/github.svg)](https://agentmods.dev/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl)
Your own site
<a href="https://agentmods.dev/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl"><img src="https://agentmods.dev/badge/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for exa-crawl

Your own site · 80×15
<a href="https://agentmods.dev/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl"><img src="https://agentmods.dev/badge/commands/thangnguyenworkspace/company-research-pipeline/exa-crawl.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 23 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 497 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00023 $0.00497
Opus 5 $0.00012 $0.00249
Sonnet 5 $0.00005 $0.00099
Haiku 4.5 $0.00002 $0.00050

Measured 12d ago against content hash 23655fe8ab28, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

exa-crawl scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

5. **Time-sensitive content warning**: if the page carries versions, prices, or live statuses, note in the file header that a cached or crawled copy may lag the system of record, and suggest a direct `curl` of the underl
.claude/commands/exa-crawl.md · 25 lines

What it actually says

Exa Crawl

Crawl the URL(s) in $ARGUMENTS and save the raw content to disk. If no URL was given, ask for one. Default output directory: the current company's topic gather folder if one is active, otherwise ask.

Procedure

  1. Batch: put every requested URL into a single crawling_exa call (urls array). Set maxCharacters to a large value (e.g. 1000000); omitting it silently truncates pages at ~3,000 characters. PDFs crawl the same way as pages.
  2. Save raw: write each result to its own file in the output directory, named from the URL host and path, with a small header recording the URL, fetch date, and tool used. Never paraphrase into the raw file; it is evidence, not summary.
  3. Classify honestly, per URL:
    • clean: substantive full content.
    • partial: content present but visibly incomplete (truncated tables, missing body sections).
    • paywalled: body under ~500 characters plus a subscribe/sign-in prompt. No fallback exists; report it and suggest finding the content elsewhere.
    • failed: empty or error.
  4. Fallback (for failed and empty results, one retry only): web_search_advanced_exa with the query set to the URL's host + path, numResults: 3. This hits Exa's cached index and often recovers JavaScript-heavy pages. If the cache hit succeeds, save it and mark the file clean (via cached index; check in-body dates for staleness).
  5. Time-sensitive content warning: if the page carries versions, prices, or live statuses, note in the file header that a cached or crawled copy may lag the system of record, and suggest a direct curl of the underlying API when one exists (method/04-tools.md section 3).

Return

A per-URL table: URL, status, output file path, one-line content summary. The file on disk is authoritative; never report a save that did not happen.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 25 lines · 23 tokens per session scan A 23655fe8ab28

Subscribe to this mod's changes

exa-crawl is a command published in the GitHub repository thangnguyenworkspace/company-research-pipeline (2 stars, last pushed 1mo ago), licensed MIT. It adds 23 tokens to every session and 497 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.