web-forager AGENTS.md

Repository instructions for Web Forager, a tool that lets AI agents search the web, find news, and fetch webpage contents through a server or command-line program.

In plain words
What is it for?
Use them when modifying Web Forager code, command-line options, server tools, search, news, URL fetching, tests, or documentation.
Why use it?
They tell contributors which project rules, tests, documentation, and quality checks to follow when changing search or fetching behavior.

Instructions file for CodexOpenCode

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add instructions/cyranob/web-forager/agents-md
Clone the repo
git clone --depth 1 https://github.com/CyranoB/web-forager

Made for: Codex, OpenCode.

Per session 286 This file is loaded in full into every session.
When invoked 286 The same file — it is already loaded in full.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00286 $0.00286
Opus 5 $0.00143 $0.00143
Sonnet 5 $0.00057 $0.00057
Haiku 4.5 $0.00029 $0.00029

Measured 2d ago against content hash ae2ddf3630c4, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

web-forager AGENTS.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

AGENTS.md · 47 lines

What it actually says

Repository guidance

Purpose

Web Forager provides web search, news search, and URL fetching for AI agents. It exposes the capabilities through a FastMCP STDIO server and a CLI, and packages agent workflows under skills/.

Search and news use ddgs. Fetching tries direct HTTP with trafilatura, then falls back to Jina Reader.

Change contract

  • Read the relevant implementation and tests before editing.
  • Keep changes focused and consistent with existing patterns.
  • Treat src/web_forager/_version.py as generated by setuptools_scm.
  • When CLI flags or MCP tool behavior changes, update the corresponding tests and README.md documentation in the same change.
  • Keep credentials and other secrets out of source, configuration, fixtures, logs, and documentation.

Development

Install the development dependencies:

uv pip install -e ".[dev]"

Run the narrowest relevant test first, then use the full checks when the change can affect multiple components:

pytest
mypy src
black --check src
isort --check-only src

Use the CLI smoke tests documented in README.md when changing search, news, fetch, or CLI behavior.

Agent workflow references

  • Before editing README prose or structure, read docs/agents/readme-style.md.
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 47 lines · 286 tokens per session scan A ae2ddf3630c4

Subscribe to this mod's changes

web-forager AGENTS.md is an instructions file published in the GitHub repository CyranoB/web-forager (10 stars, last pushed 4d ago), licensed MIT. It adds 286 tokens to every session, about $0.0014 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.