pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
- 31k
- Python
- Apache-2.0
- 7 d ago
Lightning-AI
Turn ideas into AI, Lightning fast. Creators of PyTorch Lightning, Lightning AI Studio, TorchMetrics, Fabric, Lit-GPT, Lit-LLaMA
Built from Lightning-AI's public GitHub profile, United States of America. Not on Take My Repo yet, so there are no posts or updates here.
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Machine learning metrics for distributed, scalable PyTorch applications.
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
Pytorch Lightning code guideline for conferences
Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
Common Python utilities and GitHub Actions in Lightning Ecosystem
LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified billing, tools, retries, fallback, logging. Build agents and AI apps in pure Python. Full control. Zero magic.
Automate issue discovery for your projects against Lightning nightly and releases.
A minimal Python logger that tracks everything you try when building AI - metrics, prompts, models, etc, so you can see what changed and why.
Save, load, host, and share AI model checkpoints without slowing down training. Host on Lightning AI or your own cloud with enterprise-grade access controls.
Lightweight performance tracker for Python code - zero overhead when disabled.