Testing AI Systems in Production: From LLM Evals to Agent Reliability

I am tired of seeing product managers celebrate a "smooth" deployment of an LLM feature that is slowly bleeding money or data due to subtle hallucinations. The danger isn't a crash. It is the confidence with which the model lies. We are currently trying to shoe-horn stochastic probability into deterministic test suites. This is a fundamental mismatch. I believe we must abandon the philosophy of unit testing for LLMs entirely. We test code to ensure it returns specific outputs for specific inputs