ollama-token-monitor
Real-time terminal dashboard for Ollama — live output token counting (tokens/sec), CPU & thread usage, Apple Silicon GPU utilization, VRAM and loaded models. htop for your local LLM.
- 8
- Python
- MIT
- 5 mo ago
TiniLLM
We build LLMs & the hardware that it runs on
Built from TiniLLM's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
Real-time terminal dashboard for Ollama — live output token counting (tokens/sec), CPU & thread usage, Apple Silicon GPU utilization, VRAM and loaded models. htop for your local LLM.
Pruning & Knowledge distillation methods for converting Large Language Models into Small Language Models