LLM Testing Articles

Page 1 of 1 (3 articles)

7/31/2026 • EN

How to Build an Evaluation Harness for AI Agents Before Production

A tutorial on building a vendor-neutral evaluation harness for AI agents, covering outcome, trajectory, and control checks before production deployment.

AI Agents ci/cd Evaluation Harness LLM Testing Python

Paul Bryant

10/15/2025 • EN

Serious Data From Testing LLMs

A data-driven analysis of LLM performance on a simple retrieval task, highlighting the need for evidence-based AI testing.

AI Evaluation data analysis Experimental Design LLM Testing mongodb

James Bach

10/6/2025 • EN

Seriously Testing LLMs

Explores the unique challenges of testing Generative AI and Large Language Models, contrasting it with traditional software testing approaches.

ai testing generative ai LLM Testing Regression Testing software testing

James Bach

LLM Testing Articles

How to Build an Evaluation Harness for AI Agents Before Production

Serious Data From Testing LLMs

Seriously Testing LLMs

Select Language

We use cookies