data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
- 45k
- Jupyter Notebook
- 4 mo ago
This is a repo with links to everything you'd ever want to learn about data engineering
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
Apache Spark - A unified analytics engine for large-scale data processing
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| Java-Edge/Spark-MLlib-Tutorial | 40 | None declared | Scala | 3 y ago | ||
| DataExpert-io/data-engineer-handbook | 45k | None declared | Jupyter Notebook | 4 mo ago | bigdata | Compare |
| tensorflow/tensorflow | 202k | Apache-2.0 | C++ | 5 h ago | machine-learning | Compare |
| databricks/LearningSparkV2 | 1.4k | Apache-2.0 | Scala | 22 mo ago | mllib, spark | Compare |
| DataTalksClub/data-engineering-zoomcamp | 47k | None declared | Jupyter Notebook | 2 d ago | spark | Compare |
| rustfs/rustfs | 36k | Apache-2.0 | Rust | 2 h ago | bigdata | Compare |
| f/prompts.chat | 178k | None declared | MDX | 3 h ago | machine-learning | Compare |
| apache/spark | 45k | Apache-2.0 | Scala | 1 h ago | spark | Compare |
| taosdata/TDengine | 25k | AGPL-3.0 | C | 4 d ago | bigdata | Compare |
| huggingface/transformers | 169k | Apache-2.0 | Python | 13 min ago | machine-learning | Compare |
| donnemartin/data-science-ipython-notebooks | 29k | None declared | Python | 3 y ago | machine-learning, spark | Compare |
| apache/shardingsphere | 21k | Apache-2.0 | Java | 14 h ago | bigdata | Compare |
| rasbt/LLMs-from-scratch | 109k | None declared | Jupyter Notebook | 9 d ago | machine-learning | Compare |