judge

Open repos and models their makers tagged judge, most starred first. The same for everyone.

AI on my own machineRepo

PHUDGE

Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the available tool, methods, repo, code etc to detect hallucination, LLM evaluation, grading and much more.

  • 54
  • Jupyter Notebook
  • 2 y ago
AI on my own machineRepo

neuro-oj

面向 AI 奥林匹克与认证(IOAI / NOAI / LMCC)的在线评测与竞赛平台:支持客观题、代码题、LLM 工程题与产物提交(类 Kaggle)评测。

  • 25
  • TypeScript
  • AGPL-3.0
  • 2 d ago
Neuro-OJTake it
Websites and appsRepo

arbiter

Live AI judge agent — watches hackathon demos in real-time via Gemini Live API, delivers British-accented commentary via TTS, scores with multi-model ensemble (Gemini + Claude + Groq), detects prompt injection attempts, and runs cross-team deliberation. Built for NEBULA:FOG 2026.

  • 6
  • Python
  • MIT
  • 3 mo ago
basicScandalTake it
Search GitHub and Hugging Face for judge

Get , open it once and sign in. Then come back here and press the button again.