AI Evaluation Tools

DeepEval

Open-source LLM evaluation framework for unit testing LLM outputs, agents, RAG pipelines, and prompts with various metrics.

Giskard

Open-source Python library for testing and evaluating LLM agents and models, offering automated checks, LLM judges, and red-teaming.

LangSmith

Evaluation platform for LLM and AI agents, integrated with LangChain, supporting offline/online evals, human feedback, and prompt optimization.

Arize AI

AI observability and evaluation platform with comprehensive LLM evaluation capabilities for production systems and agents.