ai-docs-vector-db-hybrid-scraper: Instructions file for Codex

AGENTS.md

ai-docs-vector-db-hybrid-scraper AGENTS.md is an instructions file for Codex, OpenCode from BjornMelin/ai-docs-vector-db-hybrid-scraper. It costs 1,072 tokens per session, scanned A, original, MIT.

Repository instructions for a project that collects documents from the web, processes them, and supports search with an AI retrieval system. They describe the project layout, development commands, coding conventions, and tests.

In plain words
What is it for?
They help maintain the crawler, document-processing pipelines, APIs, search and vector-database services, deployment files, and the project’s different test suites.
Why use it?
They give coding agents the project-specific context needed to change the right files and follow the repository’s build and testing practices.

Instructions file for CodexOpenCode

Written for Codex and OpenCode: the file is AGENTS.md.

This is BjornMelin/ai-docs-vector-db-hybrid-scraper's own configuration. It tells Codex and OpenCode how to work on ai-docs-vector-db-hybrid-scraper itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything ai-docs-vector-db-hybrid-scraper configures →

Reuse

Borrowing it

Nothing to install: this file belongs to BjornMelin/ai-docs-vector-db-hybrid-scraper. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/BjornMelin/ai-docs-vector-db-hybrid-scraper/main/AGENTS.md
Clone the repo
git clone --depth 1 https://github.com/BjornMelin/ai-docs-vector-db-hybrid-scraper

Made for: Codex, OpenCode.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for ai-docs-vector-db-hybrid-scraper AGENTS.md

README.md
[![agentmods](https://agentmods.dev/badge/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md/github.svg)](https://agentmods.dev/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md)
Your own site
<a href="https://agentmods.dev/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md"><img src="https://agentmods.dev/badge/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for ai-docs-vector-db-hybrid-scraper AGENTS.md

Your own site · 80×15
<a href="https://agentmods.dev/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md"><img src="https://agentmods.dev/badge/instructions/bjornmelin/ai-docs-vector-db-hybrid-scraper/agents-md.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 1,072 This file is loaded in full into every session.
When invoked 1,072 The same file — it is already loaded in full.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.01072 $0.01072
Opus 5.5 $0.00429 $0.00429
Sonnet 5.5 $0.00214 $0.00214
Haiku 4.5 $0.00107 $0.00107

Measured 2mo ago against content hash 8303747cd20d, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

ai-docs-vector-db-hybrid-scraper AGENTS.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

AGENTS.md · 49 lines

How it starts

The opening of the file, as written. The whole thing — 49 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Repository Guidelines

Project Structure & Module Organization

Runtime code lives in src/ (FastAPI api, LangGraph services, CLI cli, MCP tooling mcp_tools). Configs and deploy assets: config/, docker-compose.yml, k8s/; automation lives in scripts/; docs in docs/; tests span unit, integration, performance, property, data_quality, scripts suites. src/services highlights: agents (LangGraph flows), analytics (search dashboards), browser (tiered scraping), cache (Dragonfly caches), circuit_breaker (resilience), content_intelligence (classifiers/metadata), core (project storage & Qdrant aliases), crawling (Firecrawl/Crawl4AI), embeddings (FastEmbed/OpenAI), fastapi (dependency wiring), functional (DI facades), hyde (HyDE augmentation), managers (platform managers), middleware (rate limiting), monitoring (metrics/health/telemetry), observability (tracing configs), processing (batch pipelines), query_processing (intent models + orchestrator), rag (pipeline/generator/retriever), utilities (HNSW tuning/rate limits), vector_db (Qdrant service layer).

Build, Test, and Development Commands

Install deps via uv sync --dev. Drive daily flows with uv run python -m src.cli.unified … (dev, docs, services --action start --stack simple|enterprise). Use uv run python scripts/dev.py for profiles: test --profile quick, eval --dataset tests/data/rag/golden_set.jsonl, benchmark --suite performance, validate --check-docs --check-services, quality --fix-lint. Targeted gates: uv run ruff format <paths>, uv run ruff check <paths>, uv run pyright <paths>, and uv run pylint <modules> (score ≥9.5). Start local services with docker compose --profile simple up -d; make quality-unit yields a lint/type/test gate.

Coding Style & Naming Conventions

Use 4-space indentation, full type hints, and Google-style docstrings on public APIs. Keep modules lowercase_with_underscores, classes PascalCase, and functions/tests snake_case. Favor maintained components (LangGraph nodes, Prometheus helpers, FastEmbed) over bespoke utilities, and run uv run ruff format ., uv run ruff check . --fix, uv run pylint --fail-under=9.5 src scripts, and uv run pyright before pushing.

Read the full file on GitHub · 49 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2mo ago First seen · 49 lines · 1,072 tokens per session scan A 8303747cd20d

Subscribe to this mod's changes

ai-docs-vector-db-hybrid-scraper AGENTS.md is an instructions file published in the GitHub repository BjornMelin/ai-docs-vector-db-hybrid-scraper (11 stars, last pushed 3mo ago), licensed MIT. It adds 1,072 tokens to every session, about $0.0043 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

ai-docs-vector-db-hybrid-scraper AGENTS.md compared with instructions from other repositories

ai-docs-vector-db-hybrid-scraper AGENTS.md next to 6 instructions from other repositories
ModTypeStarsLast pushLicenceScanTokensWorks with
ai-docs-vector-db-hybrid-scraper AGENTS.mdBjornMelin/ai-docs-vector-db-hybrid-scraperInstructions file113mo agoMITA1,072Codex, OpenCode
vscode buildNext.instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA9,719GitHub Copilot
next.js AGENTS.mdvercel/next.jsInstructions file143kyesterdayMITA7,461Codex, OpenCode
langchain AGENTS.mdlangchain-ai/langchainInstructions file149kyesterdayMITA4,680Codex, OpenCode
vscode oss-third-party-notices.instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA5,516GitHub Copilot
vscode copilot-instructions.mdmicrosoft/vscodeInstructions file195kyesterdayMITA3,093GitHub Copilot
deepseek-harness AGENTS.mddeepseek-ai/deepseek-harnessInstructions file274k2d agoMITA4,313Codex, OpenCode