Routing Notes.
3 entries on systems, routing, and open source. Long-form posts, published slowly.
The Philosophy of vLLM SR
vLLM Semantic Router is not a smarter model picker. It is a control plane for turning semantic work into explainable capability paths across models, tools, memory, policy, gateways, and hardware.
Semantic Routing as Energy Infrastructure
Not every token deserves a frontier model. Every semantic workload deserves the right intelligence budget.
The Second Half of LLM Routing
tldr: We’re reaching LLM routing’s halftime.