Back to App Installations list

optillm

4.3k

Optimizing inference proxy for LLMs

github.com/algorithmicsuperintelligence/optillm

Install optillm with one command

Fresh Ubuntu/Debian server, 2 GB RAM, 1 CPU at least.

Success rate0.0%
Deploys1
Errors1
Warnings0
Deploys per week
1
Week 44

Known issues & fixes