Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce…
Scrapling is an adaptive web scraping framework that handles everything from a single request to a full-scale crawl. Its parser learns from website changes and automatically relocates elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box.
Its spider framework supports concurrent multi-session crawls with pause/resume and automatic proxy rotation. Scrapling requires Python 3.10 or higher. Scrapling has 92% test coverage and full type hints coverage.
Scrapling is licensed under the BSD-3 License.
Summary drafted from the project's own website. Every sentence is backed by text on that page and was reviewed before publishing.