model-evaluation

Open repos and models their makers tagged model-evaluation, most starred first. The same for everyone.

Developer toolsRepo

folkbench

AI API 中转站推荐与评测:中转站排行榜、中转站检测、Claude / GPT / Gemini 中转站对比 · AI API relay rankings · Folkbench Switch for Claude Code, Codex & Gemini CLI

  • 4k
  • TypeScript
  • 21 h ago
FolkbenchTake it
AI agentsRepo

future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

  • 2.3k
  • Python
  • Apache-2.0
  • 5 h ago
future-agiTake it
AI agentsRepo

ms-cookbook

魔搭紫皮书|ModelScope Cookbook:面向开发者的开源模型应用实战指南,覆盖模型选型、推理、微调、评测、RAG、Agent 与 AIGC,从跑通第一个模型到构建实际应用。

  • 528
  • HTML
  • Apache-2.0
  • 2 wk ago
modelscopeTake it
GitHubRepo

ruv-FANN

Neural networks and weight-space programming in Rust, JavaScript and WebAssembly. Inspect activations, edit weights, evaluate candidates, train small models, and explicitly promote or roll back revisions.

  • 396
  • Rust
  • MIT
  • 5 d ago
ruvnetTake it
AI on my own machineRepo

model-serving-minefield

Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.

  • 178
  • Python
  • MIT
  • 4 d ago
BlackwellboyTake it
Data and analyticsRepo

Sales_Conversion_Optimization_MLOps_Project

Sales Conversion Optimization MLOps: Boost revenue with AI-powered insights. Features H2O AutoML, ZenML pipelines, Neptune.ai tracking, data validation, drift analysis, CI/CD, Streamlit app, Docker, and GitHub Actions. Includes e-mail alerts, Discord/Slack integration, and SHAP interpretability. Streamline ML workflow and enhance sales performance.

  • 20
  • HTML
  • 20 mo ago
Developer toolsRepo

falsify

Fix the pass bar before the test runs. PRML is an open spec and CLI that hashes and timestamps evaluation criteria (SHA-256, RFC 3161) so anyone can check them later. Python, JS, Go, Rust.

  • 8
  • Python
  • MIT
  • 10 h ago
falsify-devTake it
AI on my own machineRepo

compound

Which host should serve your open model? Run your workload across pinned, verified providers and get one table: success, cost, latency, cache hits.

  • 8
  • TypeScript
  • Apache-2.0
  • 2 wk ago
aktasbatuhanTake it
Language and translationRepo

Detecting-the-Machine-A-Comprehensive-Benchmark-of-AI-Generated-Text-Detectors-Across-Architectures

This project aims to address this gap by conducting a systematic, controlled study of human versus LLM-generated text detectability using paired question–answer datasets. Rather than proposing a novel detection architecture, the focus is on analyzing detection robustness, failure modes, and the impact of adversarial humanization strategies.

  • 8
  • Jupyter Notebook
  • MIT
  • 8 mo ago
MadsDoodleTake it
Search GitHub and Hugging Face for model-evaluation

Get , open it once and sign in. Then come back here and press the button again.