rag-evaluation

Open repos and models their makers tagged rag-evaluation, most starred first. The same for everyone.

AI agentsRepo

future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

  • 2.3k
  • Python
  • Apache-2.0
  • 13 h ago
future-agiTake it
Notes and knowledgeRepo

chunky

A local, open-source visual workspace for RAG document preparation: inspect PDF conversion, refine Markdown, compare chunking strategies, and enrich chunks before indexing.

  • 233
  • Python
  • MIT
  • 11 d ago
GiovanniPasqTake it
AI on my own machineRepo

lasagna

Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

  • 37
  • Python
  • Apache-2.0
  • 17 h ago
dolev31Take it
AI on my own machineRepo

oh-my-knowledge

OMK helps people and agents build, maintain, and reuse valuable knowledge from real work and collaboration, with readable content, traceable sources, and revision history for future tasks.

  • 25
  • TypeScript
  • MIT
  • 2 d ago
lizhiyaoTake it
AI on my own machineRepo

euron-rag-kit

Production RAG toolkit: ingestion pipelines, hybrid retrieval with reranking, cited answers and an offline evaluation suite with regression gates. Terraform for AWS, Floci for local.

  • 2
  • Python
  • MIT
  • 3 wk ago
AI on my own machineRepo

LLM-Evaluation-Intermediate-to-Advanced

hands-on repository covering intermediate to advanced techniques for evaluating Large Language Models (LLMs). Explores evaluation methodologies, performance metrics, benchmarking, hallucination detection, response quality assessment, RAG evaluation, model comparison, and automated evaluation workflows using Python & modern LLM evaluation framework.

  • 2
  • Python
  • 5 d ago
AI on my own machineRepo

llm-evaluation-harness

LLM evaluation harness for regression testing LLM and RAG systems: rule checks, semantic similarity and LLM-as-a-judge scoring from a YAML config, with baseline vs candidate run diffs. Python, with a mock adapter so CI needs no API key.

  • 1
  • Python
  • MIT
  • 4 d ago
DareDev256Take it
AI on my own machineRepo

Complete-Corrective-RAG-CRAG

A comprehensive Corrective Retrieval-Augmented Generation (CRAG) learning repository covering retrieval quality evaluation, document relevance grading, knowledge refinement, web search fallback, corrective retrieval workflows, and context-aware answer generation for building more reliable and accurate LLM applications using Python.

  • 1
  • Jupyter Notebook
  • MIT
  • 5 d ago
Search GitHub and Hugging Face for rag-evaluation

Get , open it once and sign in. Then come back here and press the button again.