Base
Hardened build
minimal ports, security patches applied at build time
LiteLLM
AWS
Azure
Artificial Intelligence (AI)
2 variations
The LiteLLM gateway unifying over a hundred LLM providers behind one OpenAI compatible API, with key management and spend tracking.
Variations
Choose the operating system, cloud and version you need. Every variation is the same hardened LiteLLM image, built and supported by cloudimg.
Overview
LiteLLM is an open source OpenAI compatible gateway that routes requests to more than a hundred LLM providers behind one API. It adds key management, model routing, load balancing and spend tracking.
Why the cloudimg image
cloudimg preinstalls LiteLLM as a service in a Python virtual environment behind an nginx reverse proxy on port 80. A master key is generated fresh on first boot with no default login, which also mints scoped virtual keys for teams, backed by 24/7 support.
Common uses
- LLM gateway
- Model routing and fallbacks
- Spend and key management
More in Artificial Intelligence (AI)
AnythingLLM
Artificial Intelligence (AI)
An all in one document chatbot and RAG workspace, ready to ingest and answer over your own files on launch.
Di
Dify
Artificial Intelligence (AI)
Dify, a source available platform for building LLM apps, agents, RAG and workflows from a visual console.
Flowise
Artificial Intelligence (AI)
A visual low code builder for AI agents and LLM workflows, ready to run behind a unique login on first boot.
In
Infinity
Artificial Intelligence (AI)
Serve text embeddings and reranking privately, behind one API with a per VM credential and no default login.
Ie
Infinity Embeddings
Artificial Intelligence (AI)
The Infinity GPU server for text embeddings and reranking, with an OpenAI compatible API on port 80.
Ls
Label Studio
Artificial Intelligence (AI)
The Label Studio data labeling platform for machine learning, secured behind nginx with per instance credentials.