data-engineering-wiki
The best place to learn data engineering. Built and maintained by the data engineering community.
- 2.1k
- CSS
- CC0-1.0
- 2 mo ago
The best place to learn data engineering. Built and maintained by the data engineering community.
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
LLM-based ontological extraction tools, including SPIRES
Build a data warehouse in SQL Server from two source systems, a CRM and an ERP, through bronze, silver and gold. The files and scripts of the free full project.
:zap: A collection of resources and tutorials to design a better database schema.
Publisher is the open-source analytics engine for Malloy. It lets you define data models once — and use them everywhere.
A developer experience centered on CUE. Unifies schemas, data models, deterministic and agentic code generation, workflow and task engine, dagger powered environments, coding assistant, and vscode extension; woven together on the CUE lattice. Squint harder if you can't see the cube :]
ER diagram generator. Paste CREATE TABLE statements and get a clean, interactive ERD — runs 100% in your browser, nothing uploaded
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
🪨 CairnCMS provides open content and data infrastructure for self-hosted teams.
I recently tried designing a Data Warehouse for Zomato/Swiggy, one of the leading online food delivery platforms. This project has provided me with invaluable hands-on experience, allowing me to apply my skills and knowledge in a real-world scenario.