I benchmarked 3 local LLMs on 50 factual questions -here's what failed

I spent the last few days building an open-source hallucination benchmark for local LLMs. Here's what I found. The setup 50 factual questions across 5 categories 3 models: llama3.2, mistral, phi3 Running 100% locally using Ollama - no API keys needed The leaderboard Model Accuracy Correct/Total Avg Latency llama3.2 94% 47/50 5141ms phi3 88% 44/50 12780ms mistral 86% 43/50 11218ms The failures llama3.2 failed on: "What is the speed of light in km/s?" → expected 299792 "What is the capital of Braz