litellm

Open repos and models their makers tagged litellm, most starred first. The same for everyone.

AI on my own machineRepo

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

  • 64k
  • Python
  • 6 h ago
BerriAITake it
AI on my own machineRepo

GoModel

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

  • 1.3k
  • Go
  • MIT
  • 4 h ago
ENTERPILOTTake it
AI on my own machineRepo

ai-gateway

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

  • 295
  • Go
  • Apache-2.0
  • 5 d ago
ferro-labsTake it
AI on my own machineRepo

ccproxy

Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours

  • 362
  • Python
  • 3 mo ago
starbaserTake it
AI agentsRepo

agentpool

A unified agent orchestration hub that lets you configure and manage multiple AI agents (native, ACP, AGUI, Claude Code) via YAML, and exposes them through standardized protocols (ACP/OpenCode Server).

  • 200
  • Python
  • MIT
  • 14 h ago
phil65Take it
AI on my own machineRepo

self-hosted-ai-stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

  • 180
  • Shell
  • MIT
  • 2 d ago
hwdsl2Take it
AI on my own machineRepo

awesome-ai-gateway

⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

  • 158
  • HTML
  • CC0-1.0
  • 10 h ago
cuihuanTake it
AI on my own machineRepo

ChatOpsLLM

To simplify and streamline LLM operations, empowering developers and organizations to harness the full potential of large language models with ease.

  • 143
  • Svelte
  • MIT
  • 22 mo ago
bmd1905Take it
AI on my own machineRepo

rag-ops

This project applies the core knowledge from the LLMOps module, including the design and implementation of the API Layer, Inference Layer, Observability Layer, Cache Layer, Guardrails Layer, Routing Layer, and the Data Ingestion Pipeline.

  • 74
  • Python
  • 7 wk ago
T-SunmTake it
AI agentsRepo

OperationKit

AI transformation infrastructure. A self-hosted knowledge base, agent board and MCP connection for putting AI to work inside a business. Run it in-house, license it as a consultant, or have us set up your server and run it for you. Works with Claude, Codex, Grok or open-weight models. Apache-2.0.

  • 69
  • TypeScript
  • Apache-2.0
  • 6 h ago
Axia-GrowthTake it
Websites and appsRepo

IHUI-AI

Eight-platform full-stack AI operating system - unifies 176 LLMs via LangGraph + MCP + A2A. Multi-tenant RLS over 340 tables, RAG knowledge base, agent marketplace. Web/API/CLI/Desktop/Extension/Mobile/Miniapp. Apache 2.0.

  • 32
  • TypeScript
  • Apache-2.0
  • 4 h ago
IHUI-INF-AITake it
AI on my own machineRepo

kame-api-rotation-for-agent-zero

🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.

  • 24
  • Python
  • MIT
  • 21 h ago
Kame696Take it
Search GitHub and Hugging Face for litellm

Get , open it once and sign in. Then come back here and press the button again.