Data Transformation

Python Library for Data Loading

Data TransformationETL Tools

dlt is a lightweight, open-source Python library for loading data from any source into well-structured datasets with automatic schema inference.

Transform Data in Your Warehouse with SQL

Data TransformationETL Tools

dbt empowers data teams to transform, test, and document data directly in the warehouse using SQL, with version control and governance built in.

Data Quality Testing and Validation Platform

Data Transformation

Great Expectations helps data teams validate, document, and monitor data quality across pipelines with automated testing and observability.

Data Validation Using Python Type Hints

Data Transformation

Pydantic is the most widely used Python data validation library, offering fast schema enforcement with type hints and a Rust-powered core engine.

Lightning-Fast DataFrame Library in Rust

Data Transformation

Polars is an open-source, Rust-powered DataFrame library delivering 10-100x faster data processing than pandas with lazy evaluation and parallelism.

A curated collection of the best data transformation and cleaning tools for normalizing, deduplicating, and enriching scraped datasets.