arc-llm-lab
Run LLMs on Intel Arc (B60, B580, B570, B50, B70, A770) with llama.cpp Vulkan: benchmarks, tuning, agent reliability evals, raw data.
- 12
- Python
- MIT
- 2 d ago
Run LLMs on Intel Arc (B60, B580, B570, B50, B70, A770) with llama.cpp Vulkan: benchmarks, tuning, agent reliability evals, raw data.
Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63 tok/s; MTP3 measured lossy on 27% of a fixed 329-item set), Nemotron Bolt 74B, Flash-Next, dual-card routes, and a machine-checked catalog where each speculative row states whether the drafter changes the answer.