vllm—More Efficient LLMs Inference and Service Engine
vllm—More Efficient LLMs Inference and Service Engine
This is a highly efficient and user-friendly large language model inference engine, specifically des
vllm-project
652
CUDA
Topic
·Python·
- That's all for now, only these are available at the moment -