LLMSpeculativeSampling
Fast inference from large lauguage models via speculative decoding
- 925
- Python
- Apache-2.0
- 2 y ago
Benchmark bert using TensorRT
Repo feifeibear/TensorrtBenchmark, read from GitHub 1 min ago. feifeibear has not joined Take My Repo.
feifeibear/TensorrtBenchmark is a public repo on GitHub by feifeibear. Benchmark bert using TensorRT. It declares the Apache-2.0 license on GitHub. It is written mainly in C++, has 4 stars and last changed on 2022-10-12. Nobody has reviewed it on Take My Repo yet, which says nothing about its quality. Read from GitHub on 2026-11-22.
feifeibear/TensorrtBenchmark is a public repo on GitHub by feifeibear. Benchmark bert using TensorRT.
It declares the Apache-2.0 license on GitHub.
Its maker tagged it for macOS, Windows and Linux, or as Docker or cross-platform. That is declared by the maker; Take My Repo has not tested it.
Open "Take it" on its page: Take My Repo writes an install plan for your machine and hands it to your AI agent (Claude Code, Codex or Cursor), which asks you before each step. Take My Repo has not tested it on any machine.
Its last change on GitHub was on 2022-10-12. GitHub counts 1 open issue and pull requests. Take My Repo does not judge from that whether it is maintained.
Nobody has reviewed it on Take My Repo yet, which says nothing about its quality.
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Compare different hardware platforms via the Roofline Model for LLM inference tasks.