infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- 3k
- C++
- MIT
- 10 d ago
michaelfeil
@basetenlabs | building infinity | M.Sc. ML/Robotics@TU-Munich
Built from michaelfeil's public GitHub profile, San Francisco. Not on Take My Repo yet, so there are no posts or updates here.
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
Multi-Agent Reinforcement Learning Environment for the card game SkyJo, compatible with PettingZoo and RLLIB
Experimental native FlashAttention-4 bindings for Rust and Candle, using upstream kernels
An Tensorflow.js Web App running MobileNet on ImageNet in the Github Pages & my personal website.
Materials for visualization of the Master thesis: Multi-Target Multi-Object Manipulation using Relational Deep Reinforcement Learning
Enhancing privacy and security in Computer Vision by exposing Deep Learning Embeddings as API