agentmods.dev

bda-research/node-crawler

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

Open on GitHub
6.8kStars on the repository
2Mods indexed here, across every type
2mo agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown
Sort RelevanceRecently updatedFewest tokensSecurity gradeRepo starsStars this weekTop rated 1 mods

node-crawler

01

bda-research/node-crawler

Skill Claude CodeCodex

Node.js web crawler for production-grade, large-scale tasks — NOT for simple one-off requests. Use only when: bulk scraping, batch downloading, multi-page crawling, long-running spiders, or complex multi-step workflows that need connection pooling, rate limiting, proxy rotation, automatic retries, and Cheerio parsing.…

6.8k 2mo ago A 115 tokens original MIT