hdfs

Open repos and models their makers tagged hdfs, most starred first. The same for everyone.

HomelabRepo

seaweedfs

SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

  • 36k
  • Go
  • Apache-2.0
  • 1 d ago
seaweedfsTake it
DatabasesRepo

Addax

Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.

  • 1.5k
  • Java
  • Apache-2.0
  • 16 h ago
wgzhaoTake it
Run my own servicesRepo

DevOps-Python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

  • 824
  • Python
  • MIT
  • 10 mo ago
HariSekhonTake it
HomelabRepo

CloudEon

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

  • 489
  • FreeMarker
  • Apache-2.0
  • 13 mo ago
dromaraTake it
Data and analyticsRepo

starflow

Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.

  • 219
  • Scala
  • Apache-2.0
  • 8 h ago
starlake-aiTake it
Data and analyticsRepo

rumble

Quick start: pip install jsoniq ⛈️ RumbleDB 3.1.0 "Pistachio Tree" 🌳 | Run queries on your large-scale, messy datasets (JSON, text, CSV, XML, YAML, Parquet, Delta...) | Data Lakehouse with Updates, Scripting, Declarative Machine Learning

  • 251
  • Java
  • 2 d ago
RumbleDBTake it
DatabasesRepo

blueking-dbm

DBM,数据库管理,集成了MySQL、Redis、ES、Kafka、HDFS、InfluxDB、Pulsar等多种数据库组件的全生命周期管理,提供了海量集群的批量管理能力,以及相应DB组件的集群管理工具箱,并配套DB个性化配置、高可用切换、域名管理等DB个性化服务,同时全方位的监控告警可观测能力,让数据库管理员、运维、开发等用户可以轻松完成数据库管理工作,更高效、更安全、更全面的管理数据库。 The database management platform integrates a variety of database components such as MySQL...

  • 124
  • Python
  • MIT
  • 19 h ago
GitHubRepo

wasp

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

  • 31
  • Scala
  • 5 mo ago
Search GitHub and Hugging Face for hdfs

Get , open it once and sign in. Then come back here and press the button again.