ETL Tools

Amazon Athena is a serverless, interactive query service that lets you analyze petabyte-scale data in S3 using standard SQL with pay-per-query pricing.

AWS Glue is a fully managed, serverless ETL service that discovers, prepares, and integrates data from over 100 sources into lakes and warehouses.

Meltano is an open-source, CLI-first ELT platform with 600+ connectors, GitOps workflows, and native dbt integration for data pipeline management.

dlt is a lightweight, open-source Python library for loading data from any source into well-structured datasets with automatic schema inference.

dbt empowers data teams to transform, test, and document data directly in the warehouse using SQL, with version control and governance built in.

Dagster is a data orchestration platform that helps teams build, schedule, and monitor reliable data pipelines with integrated lineage and observability.

Airbyte is an open-source ELT platform with 600+ connectors that moves data from APIs, databases, and files to warehouses and data lakes at scale.

Prefect is an open-source Python workflow orchestration framework for building resilient data pipelines with full observability and zero rewrites.

Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring data pipelines and batch workflows.