chahatsagarmain/distributed-web-crawler
Instructions file CodexOpenCode
Instructions for chahatsagarmain/distributed-web-crawler, covering distributed web crawler: agents & architecture, 1. project structure, 2. system agents & packages, a. the scheduler agent (/scheduler) and b. the worker agents (/worker).
21 2mo ago A 1,337 tokens
original Apache-2.0