Item

VLLM

in LLM Engineer Tools by Jovan Soldatovic

Like this itemFollow Jovan SoldatovicOpen in app

VLLM on “LLM Engineer Tools”, a list by Jovan Soldatovic on TheLysts.

Details

Description
High-throughput and memory-efficient inference and serving engine for LLMs.
Category
LLM Inference
URL
https://github.com/vllm-project/vllm