D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

About the project

Scrapling is a Python web-scraping framework that retrieves and parses pages, from individual requests to large crawls, while adapting when site structures change. It is used by web scrapers and other users who need extracted web data, with fetchers, selectors, spiders, proxy rotation, and command-line or MCP access. The catalogue includes a skill and an MCP add-on for working with Scrapling.

88kStars on the repository
2Mods indexed here, across every type
todayLast push, which is what freshness is scored on
BSD-3-ClauseLicence, which decides whether bodies are shown

scrapling-official

01

D4Vinci/Scrapling

Skill Claude CodeCodex

Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…

not rated 88k +1.4k today A ✓ AI review SkillSpector: warn 80 tokens original BSD-3-Clause