Keeping LLM features honest in production
5 min read
Notes on the reliability layer around a production LLM feature: fixed-case evaluation, LLM-as-judge grading, hallucination observability, and letting coding agents do real CI work without letting them mark their own homework.
llmevalsai-agentsproduction