ai-observability

Open repos and models their makers tagged ai-observability, most starred first. The same for everyone.

AI agentsRepo

future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

  • 2.3k
  • Python
  • Apache-2.0
  • 14 h ago
future-agiTake it
DatabasesRepo

ZizkaDB

Audit trail database for AI agents. Tamper-evident, checksum-backed decision logs with session replay and time-travel debugging to support EU AI Act Article 12 record-keeping. Drift detection, MCP, Python & TypeScript SDKs. Self-host or cloud.

  • 165
  • Python
  • AGPL-3.0
  • 3 d ago
ZIZKA-AI-SLTake it
AI agentsRepo

claudewatch

AgentOps for Claude Code. Monitors AI agent behavior during development: real-time error loops, drift detection, friction analysis. Claude gets self-awareness hooks + MCP tools. You get cost-per-commit, agent success rates, exportable metrics. Like DevOps, but for AI agents.

  • 9
  • Go
  • MIT
  • 9 mo ago
AI agentsRepo

Evaluating-AI-Agents

A hands-on course repository for Evaluating AI Agents, created with Arize AI, that teaches you how to systematically evaluate, debug, and improve AI agents using observability tools, structured experiments, and reliable metrics. Learn production-grade techniques to enhance agent performance during development and after deployment.

  • 2
  • Jupyter Notebook
  • 19 mo ago
ksm26Take it
AI on my own machineRepo

LangSmith-Framework-Crash-Course

Covering its core concepts, agent orchestration workflows, and essential tools. Design, implement, and manage multi-agent systems, integrate memory and tool-augmented reasoning, and deploy real-world AI agents efficiently. The course emphasizes hands-on, practical applications so you can immediately apply the knowledge to production-grade projects.

  • 1
  • Python
  • MIT
  • 15 mo ago
Search GitHub and Hugging Face for ai-observability

Get , open it once and sign in. Then come back here and press the button again.