url-fetcher

url-fetcher is an agent for coding agents from datacore-one/datacore. It costs 37 tokens per session (1,613 once invoked), scanned A, original, MIT.

A sub-agent that fetches content from web URLs and returns cleaned, structured Markdown with metadata. It can try alternative sources when a page cannot be read, including web archives.

In plain words
What is it for?
Use it to retrieve readable source material for a larger knowledge-extraction or research workflow.
Why use it?
It saves the effort of copying and cleaning web pages and provides fallback options for inaccessible or paywalled content.

Agent

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/datacore-one/datacore/url-fetcher
Clone the repo
git clone --depth 1 https://github.com/datacore-one/datacore

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for url-fetcher

README.md
[![agentmods](https://agentmods.dev/badge/agents/datacore-one/datacore/url-fetcher.svg)](https://agentmods.dev/agents/datacore-one/datacore/url-fetcher)
Your own site
<a href="https://agentmods.dev/agents/datacore-one/datacore/url-fetcher"><img src="https://agentmods.dev/badge/agents/datacore-one/datacore/url-fetcher.svg" alt="Measured on agentmods" height="20"></a>
Per session 37 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,613 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00037 $0.01613
Opus 5 $0.00018 $0.00807
Sonnet 5 $0.00007 $0.00323
Haiku 4.5 $0.00004 $0.00161

Measured yesterday against content hash eeaf9ad6875d, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

url-fetcher scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.datacore/agents/url-fetcher.md · 200 lines

How it starts

The opening of the file, as written. The whole thing — 200 lines — stays where its author put it; the contents beside it link to each section on GitHub.

URL Fetcher

Engram Injection

Before starting work, load relevant learned patterns:

  1. Preferred: Call plur_admin MCP tool with action = "plur_inject_hybrid", prompt = your task description, scope = agent:url-fetcher
  2. Fallback: If MCP is unavailable, read .datacore/state/agent-engrams/url-fetcher.md for compiled engrams

Engrams encode learned behavioral patterns that improve task quality.

Agent Context

When to Reference This Agent

Called by: knowledge-extractor when input is a URL (starts with http(s)://)

Purpose: Fetch clean, structured content from a URL using a fallback chain. This is a content extraction agent, not a knowledge creation agent.

Quick Reference

Question Answer
Who calls me? knowledge-extractor
What do I return? Cleaned markdown + metadata JSON
Fallback chain? Jina Reader -> WebFetch -> archive.org
My model? haiku (fast extraction, no synthesis)

Related DIPs

Related Agents

Agent Relationship
knowledge-extractor Spawns me for URL inputs

Your Role

You are a content extraction specialist. Your only job is to fetch web content, clean it, and return structured output. You do NOT create notes, zettels, or any knowledge artifacts -- that is the coordinator's job.

Input

You receive a URL and optional context:

  • url — the URL to fetch
  • context — optional description of what the content is about

Workflow

Step 1: Validate URL

  • Confirm URL is well-formed (starts with http:// or https://)
  • Check for common URL issues (encoded characters, trailing slashes)
  • Detect if URL points to a PDF (.pdf extension or content-type) — if so, note this in metadata

Read the full file on GitHub · 200 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 200 lines · 37 tokens per session scan A eeaf9ad6875d

Subscribe to this mod's changes

url-fetcher is an agent published in the GitHub repository datacore-one/datacore (4 stars, last pushed today), licensed MIT. It adds 37 tokens to every session and 1,613 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.

Related

Other agents, from other repositories

01-crm-pull

Fetch contacts, actions, pipeline data from CRM (Notion or local markdown).

assafkip/kipi-system · 22 tokens

01-calendar-pull

Fetch calendar events for the next 7 days via Google Calendar MCP.

assafkip/kipi-system · 18 tokens

brainstormer

Creative research and solution design agent. Takes a problem statement, surveys prior art (vault memory, web, papers), generates 3-5 ranked solution ideas with effort/impact/risk estimates, and identifies non-obvious connections. Use when stuck on a challenge, exploring design alternatives, or wanting creative input…

sliamh11/Deus · 0 tokens

code-reviewer

Post-implementation, pre-commit review of actual code changes against Deus-specific rules stored in a versioned rules file. Runs on the working-tree + staged diff like a PR reviewer tuned to this repo's standards (CI gates, cross-platform, token efficiency, security basics, cleanup, type safety, comment discipline…

sliamh11/Deus · 0 tokens

keystone

Structured end-to-end trace to find the FIRST broken link in a specific claim's dependency chain. Single-claim depth probe — NOT a breadth reviewer. Use when a consequential claim ("X is enforced", "Y has a fallback", "Z reaches the main agent") needs primary-evidence verification across its full chain. Advisory…

sliamh11/Deus · 87 tokens

copy-writer

Reviews all user-facing text — error messages, help text, status indicators, onboarding copy, system messages. Ensures text is clear, human, actionable, and consistent in tone. NOT about code quality — about how the product speaks to the user. Advisory (not a commit gate). Use after changes that add or modify…

sliamh11/Deus · 0 tokens