hogwild_llm
Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
- 149
- Python
- Apache-2.0
- 15 mo ago
eqimp
Built from eqimp's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache