October 17, 2026

Post Image

Applied AI: Evals

Information in this post reflects publicly available sources as of October 17, 2026. A customer complains that your support assistant gave a refund policy that is two years out of date. You look at the prompt, add a line telling the model to prefer the newest policy documents, and try the customer's question: the answer is now correct. You try four more questions you can think of, and they look fine too. You ship it. A week later, a different … Read More
by Phee Jay
×