Caching AI Responses in a Desktop App — Don't Pay Twice for the Same Question

If this is useful, a ❤️ helps others find it. All tests run on an 8-year-old MacBook Air. If a user closes the AI diagnosis overlay and reopens it, should you call Gemini again? No. Cache the result. Same input → same output. No reason to burn rate limit quota. Here's the caching layer I built into HiyokoLogcat. The problem Without caching: User clicks diagnose on error line 847 Gemini responds in 3 seconds User closes the overlay User reopens the overlay Gemini call again → 3 more seconds, 1 mo