chahatsagarmain/distributed-web-crawler

a distributed web crawler

1 file for Codex and OpenCode: distributed-web-crawler AGENTS.md — 1,337 tokens loaded in every session.

Open on GitHub

21Stars on the repository

1Files it configures its agents with

1,337Tokens loaded in every session

2Agents configured

Instructions

distributed-web-crawler AGENTS.md AGENTS.md A 1,337 tok

These files are chahatsagarmain/distributed-web-crawler's own configuration — they tell Codex and OpenCode how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.