Alternatives to codefuse-ai/ModelCache

codefuse-ai/ModelCache: A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs. No license declared. Below, the open repos Take My Repo keeps on the same subjects, most starred first. Stars measure popularity, not quality.

AI agentsRepo

ECC

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

  • 308k
  • JavaScript
  • MIT
  • 2 d ago
affaan-mTake it
AI agentsRepo

bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

  • 9.8k
  • Go
  • Apache-2.0
  • 15 h ago
maximhqTake it
AI on my own machineRepo

ai-gateway

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

  • 295
  • Go
  • Apache-2.0
  • 6 d ago
ferro-labsTake it

Side by side

NameStarsLicenseLanguageLast changeIn commonCompare
codefuse-ai/ModelCache934None declaredPython17 mo ago
affaan-m/ECC308kMITJavaScript2 d agollmCompare
maximhq/bifrost9.8kApache-2.0Go15 h agosemantic-cacheCompare
HKUDS/nanobot50kMITPython18 min agoSame needCompare
NousResearch/hermes-agent265kMITPython15 h agollmCompare
codewhale-hq/Codewhale41kMITRust5 h agollmCompare
firecrawl/firecrawl205kAGPL-3.0TypeScript14 h agollmCompare
redis/redis-vl-python436MITPython1 d agollm, semantic-cacheCompare
mozilla-ai/llamafile27kNone declaredC++13 d agoSame needCompare
DietrichGebert/ponytail196kMITJavaScript3 wk agollmCompare
ferro-labs/ai-gateway295Apache-2.0Go6 d agollm, semantic-cacheCompare
MakazhanAlpamys/Soup11kApache-2.0Python2 h agollmCompare
Significant-Gravitas/AutoGPT188kNone declaredPython14 h agollmCompare

Read from GitHub and Hugging Face. A value a source does not give is shown as unknown, never guessed.

Get , open it once and sign in. Then come back here and press the button again.