Category Architecture7 stacks

Data Engineering Tech Stacks

Pipelines, warehouses, and analytics infrastructure.

Curated Data Engineering Stacks & Recipes

7 total

Python + pandas
Recipe
Tabular data analysis and transformation with pandas on Python — foundational data-engineering tooling.
Python + Apache Spark
Recipe
Large-scale distributed data processing with PySpark.
Airflow + PostgreSQL
Recipe
Apache Airflow for workflow orchestration with PostgreSQL as the metadata database — the standard Airflow production setup.
dbt + Snowflake
Recipe
Analytics engineering with dbt models running on Snowflake — a leading modern data-stack pairing.
dbt + PostgreSQL
Recipe
dbt transformations against PostgreSQL — common for smaller warehouses and local analytics stacks.
Apache Kafka + Python
Recipe
Event streaming with Apache Kafka consumed/produced from Python services.
ClickHouse analytics
Recipe
ClickHouse as an OLAP analytics database — used for high-volume event and metrics analytics.

Explore Other Categories

Discover technology stacks across other architectural domains.

Web1 stacks Backend22 stacks Frontend8 stacks Mobile5 stacks AI / Machine Learning6 stacks Cloud / Infrastructure4 stacks Enterprise3 stacks DevOps5 stacks Full-stack13 stacks