dagster
An orchestration platform for the development, production, and observation of data assets.
- 16k
- Python
- Apache-2.0
- 1 d ago
An orchestration platform for the development, production, and observation of data assets.
A Git-first Data & AI engineering initiative across Google Cloud, Databricks, and self-hosted infrastructure. One source of truth for independent projects, reproducible workflows, and automated delivery.
Community supported integrations for the Dagster platform.
The open-source knowledge graph for finance. Gives your AI agents your general ledger and public companies' XBRL filings as structured, traceable data, on your infrastructure, with the model you choose. Ledger graphs, the SEC repository and graphs you model yourself (Parquet in, Cypher out), over MCP. Runs on one server or in your own AWS account.
Orchestrate, schedule and monitor your Kedro pipelines with Dagster.
Dagster Tutorial to get you started with Dagster as an absolute Beginner. The tutorial covers various topics like Dagster Installation, Dagster Asset, Dagster Job, Dagster Scheduler, Dagster Ops, and more. It is completely free on YouTube and is beginner-friendly without any prerequisites.
Deep-dive MLOps curriculum — 12 self-contained modules across orchestration, streaming, ML platforms, LLM apps, IaC, and observability, with projects and interview prep.
Code examples of Luigi, Prefect, Kedro, Dagster, and MageAI
Fast, drop-in Rust replacement for Python's croniter with PyO3 abi3 wheels. 17x–41x faster recurrence calculation, 100% upstream test parity (267/267 tests).
Dagster resource and asset factory for Anakin: scrape, crawl, search, Wire site actions and website monitors
A cross-platform solution for Few-Shot Instance Segmentation on mobile devices. It leverages a split-model architecture using DINOv3 as a static feature extractor and a lightweight, dynamically trained Logistic Regression classifier for specific objects.
Go library for integrating with Dagster Pipes, enabling seamless communication between external processes and Dagster workflows. It provides a set of utilities for managing context, logging, reporting asset materializations, and more.