bentoml

Open repos and models their makers tagged bentoml, most starred first. The same for everyone.

AI on my own machineRepo

AladdinAI

AladdinAI: open-source BYOI (Bring Your Own Infrastructure) AI Agent platform. Connect your own VMs, NVIDIA NIM, OpenAI, Anthropic, Ollama — build and manage AI agents visually.

  • 23
  • Python
  • Apache-2.0
  • 2 d ago
AI on my own machineRepo

model-serving-stack

Production LLM serving infrastructure using Triton Inference Server, vLLM, and Ray Serve with OpenAI-compatible endpoints. Includes Kubernetes autoscaling configs driven by DCGM GPU metrics and a BentoML packaging path for portable model deployment.

  • 1
  • Python
  • MIT
  • 2 mo ago
TylrDnTake it
Search GitHub and Hugging Face for bentoml

Get , open it once and sign in. Then come back here and press the button again.