pipeline

Open repos and models their makers tagged pipeline, most starred first. The same for everyone.

AutomationRepo

kestra

Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

  • 30k
  • Java
  • Apache-2.0
  • 2 d ago
kestra-ioTake it
Data and analyticsRepo

marimo

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

  • 24k
  • Python
  • Apache-2.0
  • 21 h ago
marimo-teamTake it
Run my own servicesRepo

airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

  • 22k
  • Python
  • 2 d ago
airbytehqTake it
Creative codingRepo

GameDevMind

最全面的游戏开发技术图谱(Game Development Map)。帮助游戏开发者们在已知问题上节省时间,省出更多的精力投入到更有创造性的工作中去。

  • 6.7k
  • Python
  • MIT
  • 2 d ago
gonglei007Take it
AutomationRepo

cube-studio

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台,mlops算法链路全流程,算力租赁平台,notebook在线开发,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务VGPU虚拟化,边缘计算,标注平台自动化标注,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库,AI模型市场,支持国产cpu/gpu/npu 昇腾生态,支持RDMA,支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式

  • 5.1k
  • 6 wk ago
tencentmusicTake it
Websites and appsRepo

saas-boilerplate

SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!

  • 3k
  • TypeScript
  • MIT
  • 12 d ago
apptensionTake it
AutomationRepo

cube-studio

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持

  • 2.6k
  • Python
  • 6 wk ago
data-infraTake it
AutomationRepo

CGraph

【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流

  • 2.3k
  • C++
  • MIT
  • 3 wk ago
ChunelFengTake it
Developer toolsRepo

instill-core

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

  • 2.3k
  • Python
  • 6 mo ago
instill-aiTake it
Data and analyticsRepo

proton

The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

  • 2.3k
  • C++
  • Apache-2.0
  • 4 d ago
timeplus-ioTake it
Search GitHub and Hugging Face for pipeline

Get , open it once and sign in. Then come back here and press the button again.

pipeline: open source repos and models on Take My Repo