Google Released Gemma 4 Yesterday. I Had It...

Google released Gemma 4 yesterday. By the time I went to bed, I had it deployed on my home lab, running real coding benchmarks at 96 tokens per second. The catch: no official llama.cpp image supported the gemma4 architecture yet. The stock CUDA images crash with unknown model architecture: 'gemma4'. So I built it from source, on the same Kubernetes cluster that serves inference. This post is about what it took to go from "model dropped" to "running in production" in about two hours on consumer h