mlc-llm
Orange-PI-5-Pro-MLC-LLM
Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro
- 25
- GPL-3.0
- 16 mo ago
SiliconMark
Apple Silicon LLM benchmark suite measuring Token/s, RAM, power draw and ANE usage. Supports Ollama, llama.cpp, MLC and GGUF.
- 3
- Python
- MIT
- 7 d ago
ReactNativeLLM
A React Native application that enables on-device Large Language Model (LLM) chat functionality with intelligent context management. Built with TypeScript and modern React Native practices.
- 4
- TypeScript
- 15 mo ago
DentAssist
On-device multimodal MedGemma 4B clinical companion for oral medicine and dental radiography (Flutter 3.22, C++ FFI, MLC-LLM, zero-cloud air-gap)
- 1
- Dart
- 7 d ago
edge-llm-iot-anomaly
GRPO-tuned Qwen2.5-3B on Jetson Orin NX 16GB for real-time multi-modal IoT sensor anomaly detection — MIRU 2026 poster
- 1
- Python
- MIT
- 3 mo ago
droid-loom
Android agent runtime and workflow compiler for local LLM-powered screen/API automation
- 1
- 6 mo ago
nimittam
Privacy-first on-device LLM inference for Android. Real-time AI conversations without data leaving your phone. Powered by MLC-LLM.
- 1
- Kotlin
- 9 mo ago
TC-Mini
TC Mini: private on-device AI that runs in your phone or PC browser (WebGPU) or Ollama/LM Studio. Abliterated Qwen3 4B/1.7B/0.6B, signed + hash-verified downloads, no server, no telemetry, works offline.
- 0
- HTML
- Apache-2.0
- 8 d ago
mlc-llm-on-jetson
MLC-LLM source build recipe for Jetson Orin — 53.7 tok/s on Qwen3-1.7B q4f16_1
- 0
- Shell
- 4 wk ago
TinySwallow-1.5B-Instruct-q4f32_1-MLC-tensor-cache-mirror
Text generation model, used with transformers.
- 0
- 0
- apache-2.0
- 4 mo ago
browser-local-rag-lab
Reproducible research lab for browser-local small-model RAG with WebGPU/WebLLM runtimes, evidence-packet compression, latency benchmarks, and rights-aware archive fixtures.
- 0
- JavaScript
- MIT
- 5 mo ago
Rimrock-Runtimes
Inference runtime benchmarks, configs, and production setup for a Jetson Orin Nano Super 8GB — llama.cpp, ONNX Runtime, MLC-LLM, Gemma 4, multimodal
- 0
- Python
- 7 mo ago

