Llama-Server Router Mode - Dynamic Model Switching Without Restarts

For a long time, llama.cpp had a glaring limitation: you could only serve one model per process , and switching meant a restart. That era is over. Recent updates introduced router mode in llama-server , bringing something much closer to what people expect from modern local LLM runtimes: dynamic model loading unloading on demand switching per request no process restart In other words: Ollama-like behavior, but without the training wheels . If you are still deciding between local runtimes, cloud A