marlin
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
- 1.2k
- Python
- Apache-2.0
- 2 y ago
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
shadcn/ui registry of playful, highly animated button components with evil aesthetics and killing interactions.
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| codewithdark-git/QuantLLM | 18 | MIT | Python | 3 wk ago | ||
| IST-DASLab/marlin | 1.2k | Apache-2.0 | Python | 2 y ago | 4bit, llm, quantization | Compare |
| pico-8/awesome-PICO-8 | 3.1k | CC0-1.0 | Unknown | 4 mo ago | 8bit | Compare |
| debpalash/VoiceStudio | 116k | AGPL-3.0 | Python | 2 h ago | huggingface | Compare |
| affaan-m/ECC | 309k | MIT | JavaScript | 3 d ago | llm | Compare |
| HKUDS/nanobot | 50k | MIT | Python | 4 h ago | Same need | Compare |
| radiumcoders/Evil-Buttons | 302 | Apache-2.0 | TypeScript | 8 d ago | 8bit | Compare |
| NandhaKishorM/laya | 36k | Apache-2.0 | Python | 1 d ago | huggingface | Compare |
| NousResearch/hermes-agent | 265k | MIT | Python | 3 h ago | llm | Compare |
| codewhale-hq/Codewhale | 41k | MIT | Rust | 2 h ago | llm | Compare |
| zOrOjUrO/4BitCPU-Simulation-Logisim | 4 | None declared | Unknown | 4 y ago | 4bit | Compare |
| FujiNetWIFI/fujinet-firmware | 300 | GPL-3.0 | C | 22 h ago | 8bit | Compare |
| huggingface/agents-course | 35k | Apache-2.0 | MDX | 6 d ago | huggingface | Compare |