agentmods.dev

chahatsagarmain/distributed-web-crawler

a distributed web crawler

Open on GitHub
21Stars on the repository
1Mods indexed here, across every type
2mo agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown
Sort RelevanceRecently updatedFewest tokensSecurity gradeRepo starsStars this weekTop rated 1 mods

distributed-web-crawler AGENTS.md

01

chahatsagarmain/distributed-web-crawler

Instructions file CodexOpenCode

Instructions for chahatsagarmain/distributed-web-crawler, covering distributed web crawler: agents & architecture, 1. project structure, 2. system agents & packages, a. the scheduler agent (/scheduler) and b. the worker agents (/worker).

21 2mo ago A 1,337 tokens original Apache-2.0