modern-data-stack

Open-source Pricing and Billing Infrastructure 🚀 Subscription management, Invoicing, Pricing, Usage-based billing, Cost limiting, Grandfathering, Experiments, Revenue analytics & Actionable insights

Data Forge — a modern data stack playground to practice flows and best practices, not just tools. Spark, Trino, Kafka, Iceberg, ClickHouse, Airflow, MinIO, Superset — all wired together locally with Docker Compose.

Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

Set up a Cost-Effective Modern Data Stack for a Charity

Lightweight, open source, locally-hosted Modern Data Stack

A simple low-cost finance data pipeline orchestration. All you need is just python & SQL.

Lambda data architecture reference project — dbt medallion models, Airflow DAGs, Superset dashboards, and Marquez lineage for Iowa retail and Covid-19 analytics on GCP

Latte is a modern data engineering toolkit.

Data Engineering notes in Vietnamese

Orca is a modern data warehouse implementation built around HackerNews data.

A list of tools frequently used in "the modern data stack". Mostly SaaS or open-source apps to work with data and get value from it.

🧱 Tinkering around with a bunch of open source data tools.

A minimal modern data stack with working data pipelines in a single Docker container.

Este projeto é um laboratório prático que implementa uma Pilha de Dados Moderna (MDS) usando containers Docker, projetado para aprendizado e experimentação com ferramentas open-source como MinIO (armazenamento S3), PostgreSQL, Apache Hive, Spark, Kyuubi, JupyterLab e Dremio.

elevata is an open-source Architecture Runtime for modern data platforms — turning metadata into explicit, discoverable, controllable, executable, auditable, and deterministic data architecture.

A curated selection of tools, libraries and services that help tame your dataflow to productively build ambitious, data driven & reactive applications on a streaming lakehouse

sediment — A dataset-agnostic, local-first analytics-engineering framework — dbt + DuckDB + a trust-first NL→SQL agent, runs offline with one command.

Deploy an open source and modern data stack in no time with Terraform

Fundamentos práticos de Engenharia de Dados: Cloud (AWS, GCP, Azure), ingestão batch e streaming, dbt, Spark, Airflow e Modern Data Stack — com exemplos de código e cenários end-to-end.

Conecte os dados do Facebook Ads ao seu banco de dados Postgres com Airbyte e Mage.