Back to App Installations list
Llm Compressor
State-of-the-art LLM compression, built for production inference with vLLM
github.com/vllm-project/llm-compressorInstall Llm Compressor with one command
Fresh Ubuntu/Debian server, 2 GB RAM, 1 CPU at least.
Success rate100.0%
Deploys1
Errors0
Warnings1
Known issues & fixes
ProblemWhereCountStatus
No results match your search.