Instructions file
Claude Code instructions for pixlie/SmartCrawler, covering claude.md, development workflow, core commands, build and run and build the project.
20 1y ago A 760 tokens
GPL-3.0
A smart web crawler built in Rust that uses Claude AI to select the most relevant URLs from website sitemaps based on crawling objectives.
Instructions file
Claude Code instructions for pixlie/SmartCrawler, covering claude.md, development workflow, core commands, build and run and build the project.