🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
About the project
Scrapling is a Python web-scraping framework that retrieves and parses pages, from individual requests to large crawls, while adapting when site structures change. It is used by web scrapers and other users who need extracted web data, with fetchers, selectors, spiders, proxy rotation, and command-line or MCP access. The catalogue includes a skill and an MCP add-on for working with Scrapling.
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; webfetch fails; the site has anti-bot protections; write Python code to…
★not rated 88k▲
+1.4k todayA✓ AI reviewSkillSpector: warn80 tokens
originalBSD-3-Clause