phi

Open repos and models their makers tagged phi, most starred first. The same for everyone.

AI on my own machineRepo

grps_trtllm

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

  • 160
  • Python
  • Apache-2.0
  • 12 mo ago
Search GitHub and Hugging Face for phi

Get , open it once and sign in. Then come back here and press the button again.