Web Scraping

Elegant Scraper and Crawler Framework for Golang

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

A browser automation framework and ecosystem.

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Scrapy, a fast high-level web crawling & scraping framework for Python.

Open-source AI browser automation

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

JavaScript API for Chrome and Firefox