bda-research/node-crawler

bda-research/node-crawler is a Node.js web crawler that fetches pages and exposes their contents through a server-side jQuery-like interface using Cheerio. It is used to collect and extract data from websites while managing request pools, retries, rate limits, priorities, character encodings, and proxies. Its catalogue skill teaches coding agents how to operate the crawler and avoid common usage mistakes.