xberg-io/crawlberg

High-performance web crawling engine with bindings for 11 languages

This repository also configures its own agents. See what crawlberg tells them →

185Stars on the repository

21Mods indexed here, across every type

yesterdayLast push, which is what freshness is scored on

MITLicence, which decides whether bodies are shown

Plugin Claude Code

Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.

not rated 185 +1 changed yesterday A tokens not measured original MIT