chunks
shepherd
A distributed video encoder that splits files into chunks for multiple machines
- 29
- Rust
- 4 y ago
batched-stream
Transform stream which batches a bunch of input data into groups of specified size (supporting objectMode).
- 9
- JavaScript
- 8 y ago
RAG-chunker
The easiest and most effective way tool to retrain a RAG LLM/GEN AI/Agent on your data
- 2
- Python
- Apache-2.0
- 4 wk ago
react-with-suspense-lazy
:tada: React lazy import with suspense. Easy alternative to react-loadable. Enable webpack chunks split.
- 7
- JavaScript
- MIT
- 4 y ago
mapbuddy
A python based Discord bot that fetches the Minecraft server map by creating a visualization of the MCA file format each chunk is stored in.
- 2
- JavaScript
- 19 mo ago
TextChunker
TextChunker turns text, streams, files, lists, and tables into clean, token sized chunks for retrieval augmented generation and embedding pipelines.
- 1
- C#
- MIT
- 4 d ago
bin-data
Partition data into given number of chunks and pick a representative value for each chunk.
- 1
- JavaScript
- 4 y ago


