llm-proxy

Open repos and models their makers tagged llm-proxy, most starred first. The same for everyone.

AI on my own machineRepo

opencodex

Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

  • 19k
  • TypeScript
  • MIT
  • 53 min ago
lidge-junTake it
AI agentsRepo

bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

  • 9.7k
  • Go
  • Apache-2.0
  • 13 min ago
maximhqTake it
AI agentsRepo

plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

  • 7.1k
  • Rust
  • Apache-2.0
  • 4 wk ago
katanemoTake it
AI on my own machineRepo

otari

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

  • 948
  • Python
  • Apache-2.0
  • 23 min ago
mozilla-aiTake it
Run my own servicesRepo

gemini-web2api-go

Gemini web → OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary · 把 Gemini 网页反代成 OpenAI 兼容 / Gemini 原生 API,付费号 cookie 直接用 4 Argon

  • 923
  • Go
  • MIT
  • 14 h ago
zexadevTake it
AI agentsRepo

api-relay-audit

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks. Website: https://apirelayaudit.com

  • 920
  • Python
  • AGPL-3.0
  • 6 h ago
toby-bridgesTake it
AI on my own machineRepo

NadirClaw

Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.

  • 667
  • Python
  • 6 d ago
NadirRouterTake it
Run my own servicesRepo

ccLoad

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

  • 444
  • Go
  • MIT
  • 9 h ago
caidaoliTake it
AI on my own machineRepo

ccproxy

Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours

  • 362
  • Python
  • 3 mo ago
starbaserTake it
AI on my own machineRepo

kiro2cc-proxy

Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.

  • 356
  • Rust
  • MIT
  • 11 h ago
TsinHzlTake it
AI on my own machineRepo

ai-gateway

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

  • 295
  • Go
  • Apache-2.0
  • 4 d ago
ferro-labsTake it
AI on my own machineRepo

busbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

  • 225
  • Rust
  • Apache-2.0
  • 22 h ago
GetBusbarTake it
AI on my own machineRepo

SmarterRouter

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

  • 164
  • Python
  • MIT
  • 6 mo ago
peva3Take it
AI on my own machineRepo

awesome-ai-gateway

⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

  • 158
  • HTML
  • CC0-1.0
  • 15 h ago
cuihuanTake it
AI on my own machineRepo

nexus-llm-router

Drop-in LLM router and AI gateway for OpenAI Chat Completions, Responses and Anthropic Messages APIs: 125 routing strategies (incl. feedback-aware Thompson sampling) across GPT-6, Claude Opus 5.5 / Fable 5.2, Gemini 4 and Kimi K3.1, a request feedback API, budgets, fallbacks, tenant rate limits, idempotency and audit logs.

  • 122
  • Python
  • 6 d ago
Francis1998Take it
AI on my own machineRepo

llm-gateway

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

  • 108
  • Go
  • Apache-2.0
  • 5 wk ago
openzitiTake it
AI on my own machineRepo

openapis

Free Claude API + free OpenAI API in one unified proxy. Drop-in compatible with Anthropic SDK, OpenAI SDK, Claude Code CLI, OpenCode, LangChain. 100+ models (Claude Opus 4.7, Sonnet 4.6, Haiku 4.5, GPT-5.5, GPT-5.4-mini, GPT-5.3-codex). Open beta — totally free.

  • 105
  • MIT
  • 6 mo ago
AI on my own machineRepo

cliproxy-rs

Use DeepSeek, GLM, Kimi, OpenRouter and more in Codex CLI and Claude Code: one local endpoint, API translation, failover. Single Rust binary, CLIProxyAPI-compatible.

  • 78
  • Rust
  • MIT
  • 6 h ago
vayungodaraTake it
AI on my own machineRepo

LLMApiGateway

A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter injection are also available. Especially useful to work with AI coders like Cline and RooCode and providers like OpenRouter.

  • 28
  • Python
  • MIT
  • 3 mo ago
fabiojbgTake it
AI on my own machineRepo

llm-proxy

Allows any BYOK AI editor or extension, such as Cursor or Continue, to connect to any openai-compatible LLM by aliasing it as a different model

  • 24
  • TypeScript
  • MIT
  • 17 mo ago
AlorseTake it
Run my own servicesRepo

BrighTO_Router

BrighTO LLM Router: free open-source, ultra-fast Rust LLM gateway/router and LiteLLM/Bifrost alternative with OpenAI + Anthropic APIs, Claude CLI bridge for OpenAI-compatible models, Qwen3.8 dual protocol, model load balancing, fallback routing, team API keys, token budgets, SystemOne decisions for Ollaya/Laya, JEV/DJEV and Quyết.

  • 23
  • Rust
  • Apache-2.0
  • 2 d ago
thusinh1969Take it
AI on my own machineRepo

freelm

Free LLM API for Python & Node.js: a free-only, lightweight LiteLLM/OpenRouter alternative. One OpenAI-compatible client and local /v1 endpoint over Gemini, Groq, OpenRouter, Cloudflare, Mistral, NIM, Z.ai, Cohere & Kilo, with LLM fallback that races slow providers and key rotation. Works with no API keys.

  • 22
  • Python
  • MIT
  • 6 wk ago
AI agentsRepo

vibops-mcp

117 MCP tools for GPU infrastructure + Agent FinOps — deploy LLMs, manage VMs (Proxmox/XO/vSphere), track cost per agent, enforce budgets and model policies. Works with Claude, Cursor, n8n, LangChain

  • 20
  • Python
  • MIT
  • 2 d ago
VibOpsaiTake it
Search GitHub and Hugging Face for llm-proxy

Get , open it once and sign in. Then come back here and press the button again.