vLLM

An open-source library for high-throughput and memory-efficient LLM inference and serving.

Explore on Agidapp Global