Favicon of Scrapling

Scrapling

Scrapling is an adaptive Python scraping framework that learns from website changes, handling everything from single requests to full-scale crawls.

Screenshot of Scrapling website

Scrapling is an adaptive, intelligent web scraping framework that automatically handles website changes and scales from simple requests to complex crawls.

Key Features:

  • Adaptive Selectors — Learns from website structure changes so scrapers stay resilient
  • Smart Fetching — Built-in support for both static and JavaScript-rendered pages
  • CLI Interface — Command-line tools for quick scraping tasks without writing code
  • Spider Framework — Full-featured spider system for large-scale crawling operations
  • Custom Types — Purpose-built data types for clean, structured extraction results
  • Integration Ready — Works with popular Python scraping tools and data pipelines

Whether you're maintaining long-running scrapers, prototyping extraction logic, or building production crawlers, Scrapling provides adaptive scraping that keeps working when sites change.

Share:

  • Stars

    8.8K
  • Forks

    537
  • Last commit

    2 months ago
  • License

    BSD-3-Clause
  • Language

    Python
View Repository

Similar to Scrapling

Favicon

 

  
  
Favicon

 

  
  
Favicon