Serving a model in production needs software that batches requests and manages the KV cache, and vLLM is the dominant open-source project in that role. When vLLM ships day-0 support for a new model, that model can be run on your own servers immediately. How much memory a given architecture really consumes also becomes visible through this engine's implementation.