Back to App Installations list

PowerInfer

9.8k

High-speed Large Language Model Serving for Local Deployment

github.com/Tiiny-AI/PowerInfer

Install PowerInfer with one command

Fresh Ubuntu/Debian server, 2 GB RAM, 1 CPU at least.

Success rate0.0%

Deploys1

Errors1

Warnings0

Deploys per week

Week 44

Known issues & fixes

ProblemWhereCountStatus

docker: Error response from daemon: failed to resolve reference "docker.io/panelalpha/python:3.12-slim-pa2a0d75ad": docker.io/panelalpha/python:3.12-slim-pa2a0d75ad: not found

ObservedRead more