I tested Claude's consistency across prompts — here's what I found

I tested Claude's consistency across prompts — here's what I found Every developer building an AI-powered app assumes their LLM gives consistent answers. I did too — until I actually measured it. I built llm-test-kit , an open source test suite for LLM-powered applications. While building it, I ran hundreds of tests against Claude Sonnet and discovered something that surprised me. The finding Claude is content-consistent but format-inconsistent . Run the same factual question three times and you