Base
Hardened build
minimal ports, security patches applied at build time
LocalAI
AWS
Azure
Artificial Intelligence (AI)
2 variations
LocalAI, a drop in OpenAI API replacement running local inference with no GPU required, secured on port 80.
Variations
Choose the operating system, cloud and version you need. Every variation is the same hardened LocalAI image, built and supported by cloudimg.
Overview
LocalAI is a free open source drop in replacement for the OpenAI API that runs inference on your own hardware without a GPU. It serves OpenAI compatible chat, completions, embeddings and models endpoints with a built in web UI.
Why the cloudimg image
cloudimg preinstalls LocalAI as a service with a small instruct model pre pulled, so the API and web UI work on boot behind an authenticating nginx proxy. A fresh API key and admin password are generated on first boot with no default login, the models directory sits on a dedicated resizable disk, and 24/7 support is included.
Common uses
- Local LLM inference
- OpenAI compatible API
- Embeddings generation
More in Artificial Intelligence (AI)
AnythingLLM
Artificial Intelligence (AI)
An all in one document chatbot and RAG workspace, ready to ingest and answer over your own files on launch.
Di
Dify
Artificial Intelligence (AI)
Dify, a source available platform for building LLM apps, agents, RAG and workflows from a visual console.
Flowise
Artificial Intelligence (AI)
A visual low code builder for AI agents and LLM workflows, ready to run behind a unique login on first boot.
In
Infinity
Artificial Intelligence (AI)
Serve text embeddings and reranking privately, behind one API with a per VM credential and no default login.
Ie
Infinity Embeddings
Artificial Intelligence (AI)
The Infinity GPU server for text embeddings and reranking, with an OpenAI compatible API on port 80.
Ls
Label Studio
Artificial Intelligence (AI)
The Label Studio data labeling platform for machine learning, secured behind nginx with per instance credentials.