benchmarks
avalanche
Avalanche: an End-to-End Library for Continual Learning based on PyTorch.
- 2.1k
- Python
- MIT
- 21 mo ago
InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
- 2.1k
- Python
- Apache-2.0
- 3 h ago
AutomationBench
A benchmark for evaluating AI agents on realistic business workflows
- 402
- Python
- 4 mo ago
Static-Sort
A simple C++ header-only library for fastest sorting of small arrays. Generates sorting networks on compile time via templates.
- 55
- C++
- 6 y ago
llama-vulkan-strix
Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan plus ROCmFP4/MTP and ROCmFPX, parallel slots, with prefill/decode and quality metrics measured on this rig.
- 28
- Python
- 3 mo ago
eval-genius
Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.
- 27
- Python
- Apache-2.0
- 13 d ago
ruvllm
Governed neural weight editing and coding model adaptation. Native Rust patches, exact rollback, LoRA, Claude Code routing, and reproducible benchmarks.
- 15
- Python
- Apache-2.0
- 12 d ago
inference-cost-truth
What LLM inference actually costs. 874 verified price rows across 24 providers, 378 GPU rental rates, 395 cited throughput datapoints, and a self-hosting break-even model. Every number carries a source URL, a retrieval date, and passed a mechanical evidence gate. Dated immutable snapshots. CC BY 4.0.
- 10
- Python
- 2 mo ago
llm-frontier
Tracks the cheapest way to reach each level of LLM capability, and how fast that cost is falling, from Artificial Analysis's measured cost per task. Live at llm-frontier.catalystneuro.com
- 4
- Python
- BSD-3-Clause
- 4 h ago
php-llamacpp-benchmarks
Benchmark suite: six llama.cpp-inspired optimization patterns tested on PHP 8.4 with JIT. Scaling from 1M to 1B records. Reproducible via Docker + Make.
- 2
- PHP
- 6 mo ago
pairwise-distances-reductions-asv-suite
A dedicated asv suite for scikit-learn private PairwiseDistancesReductions
- 1
- Python
- 4 y ago




