airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- 22k
- Python
- 1 d ago
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
Examples for running Debezium (Configuration, Docker Compose files etc.). Please log issues at https://github.com/debezium/dbz/issues.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
An extensible distributed system for reliable nearline data streaming at scale
SymmetricDS is database replication and file synchronization software that is platform independent, web enabled, and database agnostic. It is designed to make bi-directional data replication fast, easy, and resilient. It scales to a large number of nodes and works in near real-time across WAN and LAN networks.
Docker images for Debezium. Please log issues at https://github.com/debezium/dbz/issues.
Pluggable data replication with checkpointing, batching, and integrity events
Debezium Server runtime for standalone execution of Debezium connectors. Please log issues at https://github.com/debezium/dbz/issues.
A curated list to help you manage temporal data across many modalities 🚀.
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
Drop-in PostgreSQL caching proxy and smart read replica. Caches your hottest reads, keeps them fresh with logical replication, and takes load off your primary. You change one connection string.
Real-time, one-way CDC from production MongoDB, MySQL, MariaDB, PostgreSQL and Redis to secondary databases or GCS, with PII masking and encryption. Built for analytics, cold storage and disaster recovery.
Stream PostgreSQL changes into standard Apache Iceberg tables, built in Rust.
Kubernetes/OpenShift operator for Debezium Server. Please log issues at https://github.com/debezium/dbz/issues.
An incubating Debezium CDC connector for Vitess. Please log issues at https://github.com/debezium/dbz/issues.
A Kafka source connector capturing Scylla CDC changes
An opinionated data-centric view of Debezium components. Please log issues at https://github.com/debezium/dbz/issues.
Source for the Debezium website. Please log issues at https://github.com/debezium/dbz/issues.
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
An incubating Debezium CDC connector for Apache Cassandra. Please log issues at https://github.com/debezium/dbz/issues.
A versatile, high-performance Change Data Capture (CDC) engine built in Rust. Streams database changes into downstream systems like Kafka, Redis, NATS and etc, giving you full control over routing, transformation, and delivery.
nTangle is a Change Data Capture (CDC) code generation tool and corresponding runtime. Unlike other CDC-based technologies which replicate changes to rows, nTangle is designed to replicate business entity (aggregate) changes.
A small library to capture data changes in PostgreSQL database (CDC). Useful for implementing transactional outbox pattern.
An incubating Debezium CDC connector for Google Spanner. Please log issues at https://github.com/debezium/dbz/issues.
All Quarkus extensions provided by Debezium. Please log issues at https://github.com/debezium/dbz/issues.
A Debezium CDC connector for IBM Informix database. Please log issues at https://github.com/debezium/dbz/issues.
A Debezium CDC connector for CockroachDB database. Please log issues at https://github.com/debezium/dbz/issues.