LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- 4.4k
- Python
- Apache-2.0
- 5 h ago
NART = NART is not A RunTime, a deep learning inference framework.
Repo ModelTC/NART, read from GitHub 1 min ago. ModelTC has not joined Take My Repo.
ModelTC/NART is a public repo on GitHub by ModelTC. NART = NART is not A RunTime, a deep learning inference framework. It declares the Apache-2.0 license on GitHub. It is written mainly in Python, has 37 stars and last changed on 2023-03-02. Nobody has reviewed it on Take My Repo yet, which says nothing about its quality. Read from GitHub on 2026-11-20.
ModelTC/NART is a public repo on GitHub by ModelTC. NART = NART is not A RunTime, a deep learning inference framework.
It declares the Apache-2.0 license on GitHub.
Its maker has not tagged a system, so it is unknown here. Its README says what it needs.
Open "Take it" on its page: Take My Repo writes an install plan for your machine and hands it to your AI agent (Claude Code, Codex or Cursor), which asks you before each step. Take My Repo has not tested it on any machine.
Its last change on GitHub was on 2023-03-02. Take My Repo does not judge from that whether it is maintained.
Nobody has reviewed it on Take My Repo yet, which says nothing about its quality.
Lightweight Image Video Action Generation Inference Framework
Qwen-Image-Lightning: Speed up Qwen-Image model with distillation
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.