Deploying large language models is not only a question of choosing the right model. Infrastructure quickly becomes part of the decision. During LLM inference, model weights, activations, and the KV cache all compete for GPU… LLM Inference on Limited GPU Memory: What We Learned From Layer-Wise Model Streaming