Glossary

vLLM

vLLM is a high-throughput LLM inference and serving engine optimised for large models and batched requests. Often the right choice when you want to serve a local model to a team or production application.