sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
- 1.8k
- Python
- Apache-2.0
- 6 h ago
High Performance Serving Runtime For Interactive Super Intelligence System
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.