spark-streaming

Open repos and models their makers tagged spark-streaming, most starred first. The same for everyone.

Run my own servicesRepo

bigdata-playground

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

  • 210
  • TypeScript
  • Apache-2.0
  • 8 y ago
ChabaneTake it
DatabasesRepo

ApacheSpark

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.

  • 105
  • Python
  • MIT
  • 14 mo ago
martandsinghTake it
Run my own servicesRepo

RealTime-StockStream

RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apache Spark for data handling, and Apache Cassandra for data storage, making it a powerful yet easy-to-use tool for financial data analysis

  • 32
  • Python
  • 21 mo ago
anqorithmTake it
GitHubRepo

wasp

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

  • 31
  • Scala
  • 5 mo ago
Data and analyticsRepo

flowforge

Let's be honest - most data pipeline frameworks treat types as suggestions. Config files are strings. Schemas are "validated" at runtime. Data quality is an afterthought. So, let's do differently

  • 3
  • Scala
  • AGPL-3.0
  • 6 wk ago
vim89Take it
Search GitHub and Hugging Face for spark-streaming

Get , open it once and sign in. Then come back here and press the button again.

spark-streaming: open source repos and models on Take My Repo