hflow
SDK for robotics teams to verify the quality of their data used for AI model training.
- 311
- Python
- Apache-2.0
- 4 d ago
SDK for robotics teams to verify the quality of their data used for AI model training.
High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
Account screening, channel screening and classification with Jev for dataset curation and research. Find sign language, news, piano/instrument performance and makeup tutorial creators from titles and thumbnails. 视频平台工具:批量筛选账号与频道,寻找手语账号、新闻频道、乐器演奏与美妆博主。Douyin, Kuaishou, YouTube, Bilibili.
HyperView curates datasets and provides model introspection in hyperbolic and Euclidean geometries.
Turn internet-scale video into egocentric and exocentric training data, curated and annotated by agents on the Memories.ai datalake
Annotate any LeRobot dataset with a swarm of agents. Turn raw demos into training-ready data for robotic foundation models.
MedPMC: a high-fidelity medical image–text curation framework from biomedical literature for multimodal foundation models, with released pipelines, curated data, benchmarks, and pretrained models.
Implementation of TSDS: Data Selection for Task-Specific Model Finetuning. An optimal-transport framework for selecting domain-specific and task-specific training data to improve LLM finetuning and instruction tuning.
Semantic pipes for your terminal - PDFs, images, audio, video, and text through Unix verbs that understand
This is my personal home rig for serious LLM experimentation. I built it to test models head-to-head, create custom evaluation rubrics, automatically improve prompts based on the previous run’s results, and generate high-quality synthetic training data. Everything runs locally first (Ollama by default), with optional cloud support. logged locally.
[ACL 2024 (Findings)] ICC: Quantifying Image Caption Concreteness for Multimodal Dataset Curation
NAACL 2025 | How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?
Local-first macOS app for exploring, searching, clustering, curating, and exporting image datasets with on-device AI.