flash-attention

Open repos and models their makers tagged flash-attention, most starred first. The same for everyone.

AI on my own machineRepo

tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

  • 556
  • Python
  • 6 wk ago
zengxiao-heTake it
Images and videoRepo

Win-AI-Wheelhouse

🪟 为 Windows AI 开发者提供预编译 wheel 文件的集中仓库 | 自动抓取并整理 PyTorch、Flash Attention、xformers、SageAttention 等常用库的最新版本 | 免编译,开箱即用 | 特别适合 ComfyUI 和 Stable Diffusion 用户

  • 86
  • MIT
  • 16 h ago
BradPitaTake it
AI on my own machineRepo

vllm-windows-build

Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.

  • 68
  • Python
  • MIT
  • 2 d ago
aivrarTake it
AI on my own machineRepo

llama-cpp-pascal

Pre-tensor-core (Pascal GTX 1070) inference optimizations for llama.cpp: native Turbo3 compressed-KV flash attention, PTQ1 ternary DP4A matmuls, chunked gated-delta-net, TurboQuant/VBR KV on 80K-262K contexts

  • 22
  • Cuda
  • 12 d ago
joris-staTake it
Search GitHub and Hugging Face for flash-attention

Get , open it once and sign in. Then come back here and press the button again.