Alternatives to ymoslem/CRE-Router

ymoslem/CRE-Router: Cascaded Framework for Cost-Aware LLM Serving License Apache-2.0. Below, the open repos Take My Repo keeps on the same subjects, most starred first. Stars measure popularity, not quality.

AI agentsRepo

plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

  • 7.1k
  • Rust
  • Apache-2.0
  • 4 wk ago
katanemoTake it
AI on my own machineRepo

otari

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

  • 959
  • Python
  • Apache-2.0
  • 10 h ago
mozilla-aiTake it
AI on my own machineRepo

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

  • 15k
  • Python
  • 10 h ago
NVIDIATake it

Side by side

NameStarsLicenseLanguageLast changeIn commonCompare
ymoslem/CRE-Router4Apache-2.0Python21 h ago
ymoslem/awesome-llm-routing-cascading5None declaredUnknown5 wk agollm-cascade, llm-routingCompare
katanemo/plano7.1kApache-2.0Rust4 wk agollm-routingCompare
vllm-project/vllm97kApache-2.0Python7 h agollm-servingCompare
Unbabel/OpenKiwi236AGPL-3.0Python4 y agoquality-estimationCompare
0xNyk/council-of-high-intelligence4.9kMITShell6 d agollm-routingCompare
ray-project/ray44kApache-2.0Python1 h agollm-servingCompare
Unbabel/wmt21-qe-task9Apache-2.0Python5 y agoquality-estimationCompare
sugeerth/llm-router1MITJavaScript11 d agollm-cascade, llm-routingCompare
mozilla-ai/otari959Apache-2.0Python10 h agollm-routingCompare
liguodongiot/llm-action25kApache-2.0HTML5 wk agollm-servingCompare
AbdelStark/awesome-typesafe-jev619MITHTML3 wk agollm-routingCompare
NVIDIA/TensorRT-LLM15kNone declaredPython10 h agollm-servingCompare

Read from GitHub and Hugging Face. A value a source does not give is shown as unknown, never guessed.

Get , open it once and sign in. Then come back here and press the button again.