sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
- 39k
- Python
- Apache-2.0
- 2 h ago
SGLang is a high-performance serving framework for large language models and multimodal models.
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
A framework for efficient model inference with omni-modality models
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
A unified framework for easy fine-tuning in Flow-Matching models
A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.
[CVPR 2025] FaithDiff for Classic Film Rejuvenation, Old Photo Revival, Social Media Restoration, Image Enhancement and AIGC Enhancement.
A curated list of awesome Diffusion notebooks, tools, software, tutorials and resources.
WeeLLM runs large diffusion models with as little as 4 GB of VRAM, without any quantization. It dynamically determines how many layers can fit within the available VRAM and streams the text encoder and transformer layers to the GPU layer by layer, enabling inference on hardware with limited VRAM. It supports both safetensors and GGUF models.