Back to App Installations list
omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
github.com/jundot/omlxInstall omlx with one command
Fresh Ubuntu/Debian server, 2 GB RAM, 1 CPU at least.
Success rate100.0%
Deploys1
Errors0
Warnings1
Known issues & fixes
ProblemWhereCountStatus
No results match your search.