Awesome AI Eval

A curated list of tools, methods & platforms for evaluating AI quality in real applications.

A curated list of tools, frameworks, benchmarks, and observability platforms for evaluating LLMs, RAG pipelines, and autonomous agents to minimize hallucinations & evaluate practical performance in real production environments.

Contents

• Tools
  • Evaluators and Test Harnesses
  • RAG and Retrieval
  • Prompt Evaluation & Safety
  • Datasets and Methodology
• Platforms
  • Open Source Platforms
  • Hosted Platforms
  • Cloud Platforms
• Benchmarks
  • General
  • Domain
  • Agent
  • Safety
• Leaderboards
• Resources
  • Guides & Training
  • Examples
  • Related Collections
• Licensing

---

Tools

Evaluators and Test Harnesses

Core Frameworks

• Anthropic Model Evals - Anthropic's evaluation suite for safety, capabilities, and alignment testing of language models.
• ColossalEval - Unified pipeline for classic metrics plus GPT-assisted scoring across public datasets.
• DeepEval - Python unit-test style metrics for hallucination, relevance, toxicity, and bias.
• Hugging Face lighteval - Toolkit powering HF leaderboards with 1k+ tasks and pluggable metrics.
• Inspect AI - UK AI Safety Institute framework for scripted eval plans, tool calls, and model-graded rubrics.
• MLflow Evaluators - Eval API that logs LLM scores next to classic experiment tracking runs.
• OpenAI Evals - Reference harness plus registry spanning reasoning, extraction, and safety evals.
• OpenCompass - Research harness with CascadeEvaluator, CompassRank syncing, and LLM-as-judge utilities.
• Prompt Flow - Flow builder with built-in evaluation DAGs, dataset runners, and CI hooks.
• Promptfoo - Local-first CLI and dashboard for evaluating prompts, RAG flows, and agents with cost tracking and regression detection.
• Ragas - Evaluation library that grades answers, context, and grounding with pluggable scorers.
• TruLens - Feedback function framework for chains and agents with customizable judge models.
• W&B Weave Evaluations - Managed evaluation orchestrator with dataset versioning and dashboards.
• ZenML - Pipeline framework that bakes evaluation steps and guardrail metrics into LLM workflows.

Application and Agent Harnesses

• Braintrust - Hosted evaluation workspace with CI-style regression tests, agent sandboxes, and token cost tracking.
• LangSmith - Hosted tracing plus datasets, batched evals, and regression gating for LangChain apps.
• W&B Prompt Registry - Prompt evaluation templates with reproducible scoring and reviews.

RAG and Retrieval

RAG Frameworks

• EvalScope RAG - Guides and templates that extend Ragas-style metrics with domain rubrics.
• LlamaIndex Evaluation - Modules for replaying queries, scoring retrievers, and comparing query engines.
• Open RAG Eval - Vectara harness with pluggable datasets for comparing retrievers and prompts.
• RAGEval - Framework that auto-generates corpora, questions, and RAG rubrics for completeness.
• R-Eval - Toolkit for robust RAG scoring aligned with the Evaluation of RAG survey taxonomy.

Retrieval Benchmarks

• BEIR - Benchmark suite covering dense, sparse, and hybrid retrieval tasks.
• ColBERT - Late-interaction dense retriever with evaluation scripts for IR datasets.
• MTEB - Embeddings benchmark measuring retrieval, reranking, and similarity quality.

RAG Datasets and Surveys

• Awesome-RAG-Evaluation - Curated catalog of RAG evaluation metrics, datasets, and leaderboards.
• Comparing LLMs on Real-World Retrieval - Empirical analysis of how language models perform on practical retrieval tasks.
• RAG Evaluation Survey - Comprehensive paper covering metrics, judgments, and open problems for RAG.
• RAGTruth - Human-annotated dataset for measuring hallucinations and faithfulness in RAG answers.

Prompt Evaluation & Safety

• AlpacaEval - Automated instruction-following evaluator with length-controlled LLM judge scoring.
• ChainForge - Visual IDE for comparing prompts, sampling models, and scoring batches with rubrics.
• Guardrails AI - Declarative validation framework that enforces schemas, correction chains, and judgments.
• Lakera Guard - Hosted prompt security platform with red-team datasets for jailbreak and injection testing.
• PromptBench - Benchmark suite for adversarial prompt stress tests across diverse tasks.
• Red Teaming Handbook - Microsoft playbook for adversarial prompt testing and mitigation patterns.

Datasets and Methodology

• Deepchecks Evaluation Playbook - Survey of evaluation metrics, failure modes, and platform comparisons.
• HELM - Holistic Evaluation of Language Models methodology emphasizing multi-criteria scoring.
• Instruction-Following Evaluation (IFEval) - Constraint-verification prompts for automatically checking instruction compliance.
• OpenAI Cookbook Evals - Practical notebooks showing how to build custom evals.
• Safety Evaluation Guides - Cloud vendor recipes for testing quality, safety, and risk.
• Who Validates the Validators? - EvalGen workflow aligning LLM judges with human rubrics via mixed-initiative criteria design.
• ZenML Evaluation Playbook - Playbook for embedding eval gates into pipelines and deployments.

---

Platforms

Open Source Platforms

• Agenta - End-to-end LLM developer platform for prompt engineering, evaluation, and deployment.
• Arize Phoenix - OpenTelemetry-native observability and evaluation toolkit for RAG, LLMs, and agents.
• DocETL - ETL system for complex document processing with LLMs and built-in quality checks.
• Giskard - Testing framework for ML models with vulnerability scanning and LLM-specific detectors.
• Helicone - Open-source LLM observability platform with cost tracking, caching, and evaluation tools.
• Langfuse - Open-source LLM engineering platform providing tracing, eval dashboards, and prompt analytics.
• Lilac - Data curation tool for exploring and enriching datasets with semantic search and clustering.
• LiteLLM - Unified API for 100+ LLM providers with cost tracking, fallbacks, and load balancing.
• Lunary - Production toolkit for LLM apps with tracing, prompt management, and evaluation pipelines.
• Mirascope - Python toolkit for building LLM applications with structured outputs and evaluation utilities.
• OpenLIT - Telemetry instrumentation for LLM apps with built-in quality metrics and guardrail hooks.
• OpenLLMetry - OpenTelemetry instrumentation for LLM traces that feed any backend or custom eval logic.
• Opik - Self-hostable evaluation and observability hub with datasets, scoring jobs, and interactive traces.
• Rhesis - Collaborative testing platform with automated test generation and multi-turn conversation simulation for LLM and agentic applications.
• traceAI - Open-source multi-modal tracing and diagnostics framework for LLM, RAG, and agent workflows built on OpenTelemetry.
• UpTrain - OSS/hosted evaluation suite with 20+ checks, RCA tooling, and LlamaIndex integrations.
• VoltAgent - TypeScript agent framework paired with VoltOps for trace inspection and regression testing.
• Zeno - Data-centric evaluation UI for slicing failures, comparing prompts, and debugging retrieval quality.

Hosted Platforms

• ChatIntel - Conversation analytics platform for evaluating chatbot quality, sentiment, and user satisfaction.
• Confident AI - DeepEval-backed platform for scheduled eval suites, guardrails, and production monitors.
• Datadog LLM Observability - Datadog module capturing LLM traces, metrics, and safety signals.
• Deepchecks LLM Evaluation - Managed eval suites with dataset versioning, dashboards, and alerting.
• Eppo - Experimentation platform with AI-specific evaluation metrics and statistical rigor for LLM A/B testing.
• Future AGI - Multi-modal evaluation, simulation, and optimization platform for reliable AI systems across software and hardware.
• Galileo - Evaluation and data-curation studio with labeling, slicing, and issue triage.
• HoneyHive - Evaluation and observability platform with prompt versioning, A/B testing, and fine-tuning workflows.
• Humanloop - Production prompt management with human-in-the-loop evals and annotation queues.
• Maxim AI - Evaluation and observability platform focusing on agent simulations and monitoring.
• Orq.ai - LLM operations platform with prompt management, evaluation workflows, and deployment pipelines.
• PostHog LLM Analytics - Product analytics toolkit extended to track custom LLM events and metrics.
• PromptLayer - Prompt engineering platform with version control, evaluation tracking, and team collaboration.

Cloud Platforms

• Amazon Bedrock Evaluations - Managed service for scoring foundation models and RAG pipelines.
• Amazon Bedrock Guardrails - Safety layer that evaluates prompts and responses for policy compliance.
• Azure AI Foundry Evaluations - Evaluation flows and risk reports wired into Prompt Flow projects.
• Vertex AI Generative AI Evaluation - Adaptive rubric-based evaluation for Google and third-party models.

---

Benchmarks

General

• AGIEval - Human-centric standardized exams spanning entrance tests, legal, and math scenarios.
• BIG-bench - Collaborative benchmark probing reasoning, commonsense, and long-tail tasks.
• CommonGen-Eval - GPT-4 judged CommonGen-lite suite for constrained commonsense text generation.
• DyVal - Dynamic reasoning benchmark that varies difficulty and graph structure to stress models.
• LM Evaluation Harness - Standard harness for scoring autoregressive models on dozens of tasks.
• LLM-Uncertainty-Bench - Adds uncertainty-aware scoring across QA, RC, inference, dialog, and summarization.
• LLMBar - Meta-eval testing whether LLM judges can spot instruction-following failures.
• LV-Eval - Long-context suite with five length tiers up to 256K tokens and distraction controls.
• MMLU - Massive multitask language understanding benchmark for academic and professional subjects.
• MMLU-Pro - Harder 10-choice extension focused on reasoning-rich, low-leakage questions.
• PertEval - Knowledge-invariant perturbations to debias multiple-choice accuracy inflation.

Domain

• FinEval - Chinese financial QA and reasoning benchmark across regulation, accounting, and markets.
• LAiW - Legal benchmark covering retrieval, foundation inference, and complex case applications in Chinese law.
• HumanEval - Unit-test-based benchmark for code synthesis and docstring reasoning.
• MATH - Competition-level math benchmark targeting multi-step symbolic reasoning.
• MBPP - Mostly Basic Programming Problems benchmark for small coding tasks.

Agent

• AgentBench - Evaluates LLMs acting as agents across simulated domains like games and coding.
• GAIA - Tool-use benchmark requiring grounded reasoning with live web access and planning.
• MetaTool Tasks - Tool-calling benchmark and eval harness for agents built around LLaMA models.
• SuperCLUE-Agent - Chinese agent eval covering tool use, planning, long/short-term memory, and APIs.

Safety

• AdvBench - Adversarial prompt benchmark for jailbreak and misuse resistance measurement.
• BBQ - Bias-sensitive QA sets measuring stereotype reliance and ambiguous cases.
• ToxiGen - Toxic language generation and classification benchmark for robustness checks.
• TruthfulQA - Measures factuality and hallucination propensity via adversarially written questions.

---

Leaderboards

• CompassRank - OpenCompass leaderboard comparing frontier and research models across multi-domain suites.
• LLM Agents Benchmark Collections - Aggregated leaderboard comparing multi-agent safety and reliability suites.
• Open LLM Leaderboard - Hugging Face benchmark board with IFEval, MMLU-Pro, GPQA, and more.
• OpenAI Evals Registry - Community suites and scores covering accuracy, safety, and instruction following.
• Scale SEAL Leaderboard - Expert-rated leaderboard covering reasoning, coding, and safety via SEAL evaluations.

---

Resources

Guides & Training

• AI Evals for Engineers & PMs - Cohort course from Hamel & Shreya with lifetime reader, Discord, AI Eval Assistant, and live office hours.
• AlignEval - Eugene Yan's guide on building LLM judges by following methodical alignment processes.
• Applied LLMs - Practical lessons from a year of building with LLMs, emphasizing evaluation as a core practice.
• Data Flywheels for LLM Applications - Iterative data improvement processes for building better LLM systems.
• Error Analysis & Prioritizing Next Steps - Andrew Ng walkthrough showing how to slice traces and focus eval work via classic ML techniques.
• Error Analysis Before Tests - Office hours notes on why error analysis should precede writing automated tests.
• Eval Tools Comparison - Detailed comparison of evaluation tools including Braintrust, LangSmith, and Promptfoo.
• Evals for AI Engineers - O'Reilly book by Shreya Shankar & Hamel Husain on systematic error analysis, evaluation pipelines, and LLM-as-a-judge.
• Evaluating RAG Systems - Practical guidance on RAG evaluation covering retrieval quality and generation assessment.
• Field Guide to Rapidly Improving AI Products - Comprehensive guide on error analysis, data viewers, and systematic improvement from 30+ implementations.
• Inspect AI Deep Dive - Technical deep dive into Inspect AI framework with hands-on examples.
• LLM Evals FAQ - Comprehensive FAQ with 45+ articles covering evaluation questions from practitioners.
• LLM Evaluators Survey - Survey of LLM-as-judge use cases and approaches with practical implementation patterns.
• LLM-as-a-Judge Guide - In-depth guide on using LLMs as judges for automated evaluation with calibration tips.
• Mastering LLMs Open Course - Free 40+ hour course covering evals, RAG, and fine-tuning taught by 25+ industry practitioners.
• Modern IR Evals For RAG - Why traditional IR evals are insufficient for RAG, covering BEIR and modern approaches.
• Multi-Turn Chat Evals - Strategies for evaluating multi-turn conversational AI systems.
• Open Source LLM Tools Comparison - PostHog comparison of open-source LLM observability and evaluation tools.
• Scoping LLM Evals - Case study on managing evaluation complexity through proper scoping and topic distribution.
• Why AI evals are the hottest new skill - Lenny's interview covering error analysis, axial coding, eval prompts, and PRD alignment.
• Your AI Product Needs Evals - Foundational article on why every AI product needs systematic evaluation.

Examples

• Arize Phoenix AI Chatbot - Next.js chatbot with Phoenix tracing, dataset replays, and evaluation jobs.
• Azure LLM Evaluation Samples - Prompt Flow and Azure AI Foundry projects demonstrating hosted evals.
• Deepchecks QA over CSV - Example agent wired to Deepchecks scoring plus tracing dashboards.
• OpenAI Evals Demo Evals - Templates for extending OpenAI Evals with custom datasets.
• Promptfoo Examples - Ready-made prompt regression suites for RAG, summarization, and agents.
• ZenML Projects - End-to-end pipelines showing how to weave evaluation steps into LLMOps stacks.

Related Collections

• Awesome ChainForge - Ecosystem list centered on ChainForge experiments and extensions.
• Awesome-LLM-Eval - Cross-lingual (Chinese) compendium of eval tooling, papers, datasets, and leaderboards.
• Awesome LLMOps - Curated tooling for training, deployment, and monitoring of LLM apps.
• Awesome Machine Learning - Language-specific ML resources that often host evaluation building blocks.
• Awesome RAG - Broad coverage of retrieval-augmented generation techniques and tools.
• Awesome Self-Hosted - Massive catalog of self-hostable software, including observability stacks.
• GenAI Notes - Continuously updated notes and resources on GenAI systems, evaluation, and operations.

---

Licensing

Released under the CC0 1.0 Universal license.

---

Contributing

Contributions are welcome—please read CONTRIBUTING.md for scope, entry rules, and the pull-request checklist before submitting updates.