LocalAI, a self hosted, OpenAI compatible AI inference server, ready to run models privately from first boot.
LocalAI is an open source inference server that provides an OpenAI compatible API for running language, image, and audio models on your own hardware. It is used to build private AI applications without external services.
cloudimg delivers LocalAI hardened and fully patched on Ubuntu 24.04 LTS, preconfigured so the API responds on first boot. 24/7 support is included with every image.
Real screenshots taken while testing this image against its deployment guide.