Eval-driven development for a local-LLM agent: how I shipped Lore 0.2.0 with confidence

I maintain Lore , an open source app that manages your personal memory. It sits in the system tray, opens a chat on a global shortcut, and uses Ollama + LanceDB to capture and recall your notes and todos entirely on your machine. No cloud, no API keys, MIT license. The single hardest thing about building Lore is not the retrieval, the embeddings, or the code. It's that every prompt change silently regresses something else. It is especially hard because lore runs LLMs locally on the user's device