llm-benchmark

Open repos and models their makers tagged llm-benchmark, most starred first. The same for everyone.

Developer toolsRepo

folkbench

AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI

  • 3.2k
  • TypeScript
  • 2 d ago
FolkbenchTake it
AI on my own machineRepo

TrustLLM

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

  • 635
  • Python
  • MIT
  • 7 wk ago
HowieHwongTake it
AI on my own machineRepo

risk-aware-trading-agents

AI trading agents for US stocks with news backtesting that can't see the future: a public LLM trading agent leaderboard (rta-bench-1), frozen point-in-time 2020/2022/2026 markets (prices, VIX, news), a look-ahead check on every run, LLM agents over MCP, and paper/live trading on 10 brokers. 风险感知美股交易智能体 · 新闻回测 · LLM 榜单

  • 338
  • Python
  • MIT
  • 4 d ago
jackson-cmdTake it
AI on my own machineRepo

awesome-ai-tokenomics

A curated list on AI token economics: what tokens cost, where they get wasted, and how to cut the bill. Tools, benchmarks, papers, and copy-paste configs for the token economy of LLMs and coding agents.

  • 219
  • Python
  • CC0-1.0
  • 8 d ago
QuesmaOrgTake it
GitHubRepo

bug-hunt-bench

Bug Hunt Bench: 105 real bugs in two production repos, frontier coding models (GPT-6, Claude, Grok, Gemini, DeepSeek...) find and fix them in their own CLI, graded blind. Live leaderboard + every receipt.

  • 218
  • JavaScript
  • 3 d ago
phurynTake it
AI on my own machineRepo

token-speed-tester

LLM / Codex 测速与本机历史分析:TTFT、Token 吞吐、流式曲线,支持 CLI、网页和跨平台桌面端。Benchmark LLM / Codex streaming speed and analyze local Codex history with CLI, web & desktop apps.

  • 21
  • TypeScript
  • MIT
  • 4 wk ago
Cansiny0320Take it
Creative codingRepo

argus

Live wallpapers for macOS, one per Desktop Space, each a single Zig or Metal file you can write yourself. Flagship: Cygnus A, a spinning (Kerr) black hole and its accretion disk, traced on the GPU.

  • 3
  • Zig
  • MIT
  • 7 d ago
gke0opTake it
AI agentsRepo

hota-mcp

MCP-сервер, через который ИИ-агент играет в Героев III: Horn of the Abyss как живой игрок — настоящие кнопки, наблюдения структурой без OCR, хотсит и команды, встроенный справочник по игре. Установщик для Windows. Бенчмарк стратегического мышления LLM.

  • 3
  • C#
  • 3 d ago
timoncoolTake it
Search GitHub and Hugging Face for llm-benchmark

Get , open it once and sign in. Then come back here and press the button again.