llmaz
βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!
- 313
- Go
- Apache-2.0
- 3 mo ago
InftyAI
Exploring the β possibilities of AI. We π Open Source.
Built from InftyAI's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!
π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise π―
The control plane for GPUaaS β across neoclouds, hyperscalers, and your own infrastructure.
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
π― An unified python client to communicate with various kinds of object-store providers.
Your AI pair programmer π€οΈ specialized in code review, code summary and even code completion. π§βπ»π
A lightweight sandbox daemon for secure agent execution in isolated environments.
π An awesome & curated list of AI agents for GPU kernel generation, optimization, and verification.