D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

About the project

Scrapling is a Python web-scraping framework that retrieves and parses pages, from individual requests to large crawls, while adapting when site structures change. It is used by web scrapers and other users who need extracted web data, with fetchers, selectors, spiders, proxy rotation, and command-line or MCP access. The catalogue includes a skill and an MCP add-on for working with Scrapling.

88kStars on the repository
2Mods indexed here, across every type
todayLast push, which is what freshness is scored on
BSD-3-ClauseLicence, which decides whether bodies are shown

Scrapling

01

D4Vinci/Scrapling

MCP server Claude CodeCodexCursor +2

Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy and effortless as it should be! Runs locally from the scrapling Python package.

not rated 88k +1.4k today A Socket: warn tokens not measured original BSD-3-Clause