Back to App Installations list

vllm

95k

A high-throughput and memory-efficient inference and serving engine for LLMs

github.com/vllm-project/vllm

Install vllm with one command

Fresh Ubuntu/Debian server, 2 GB RAM, 1 CPU at least.

Success rate0.0%
Deploys2
Errors1
Warnings1
Deploys per week
5
Week 44

Based on 5 deploys recorded in the last 1 week. The totals above cover the last 365 days.

Known issues & fixes