vLLM (lib)https://docs.vllm.aiHigh-throughput serving library. vLLMhttps://github.com/vllm-project/vllmHigh-throughput GPU serving for open models.