llms-benchmarking

Open repos and models their makers tagged llms-benchmarking, most starred first. The same for everyone.

GitHubRepo

models

This repository contains comprehensive pricing and configuration data for LLMs. It powers cost attribution for 200+ enterprises running 400B+ tokens through Portkey AI Gateway every day.

  • 146
  • JavaScript
  • MIT
  • 2 d ago
Portkey-AITake it
GitHubRepo

MLLM-CompBench

[NeurIPS'25] MLLM-CompBench evaluates the comparative reasoning of MLLMs with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scenes

  • 47
  • Jupyter Notebook
  • 6 wk ago
RaptorMaiTake it
Search GitHub and Hugging Face for llms-benchmarking

Get , open it once and sign in. Then come back here and press the button again.