inference-providers

Open repos and models their makers tagged inference-providers, most starred first. The same for everyone.

AI on my own machineRepo

compound

Which host should serve your open model? Run your workload across pinned, verified providers and get one table: success, cost, latency, cache hits.

  • 8
  • TypeScript
  • Apache-2.0
  • 3 wk ago
aktasbatuhanTake it
AI on my own machineRepo

gravestone

Hardware probe and best-of-N sampling harness in C. Ranks GGUF quantisations against measured VRAM and RAM, drives Ollama or llama.cpp over OpenAI-format HTTP on localhost, and gates every candidate behind a static check and a test run.

  • 1
  • C
  • 2 mo ago
ahmedwaqas92Take it
Search GitHub and Hugging Face for inference-providers

Get , open it once and sign in. Then come back here and press the button again.

inference-providers: open source repos and models on Take My Repo