LiteLLM, a unified proxy for many LLM providers, ready to route AI requests through one API from first boot.
This product is available in the build below. Open it for the operating system, cloud and version detail, or read its deployment guide.
| Product | Cloud | Operating system | Version | |
|---|---|---|---|---|
| LiteLLM on Ubuntu 24.04 LTS | Azure | Ubuntu 24.04 | Standard | View · Guide |
LiteLLM is a proxy and gateway that exposes a single, OpenAI compatible API across many large language model providers, with routing, spend tracking, and rate limiting. It is used to standardise and govern access to LLMs across an organisation.
cloudimg ships LiteLLM hardened and fully patched, preconfigured so the proxy answers on first boot. A unique administrator credential is generated on first boot with no default login, and 24/7 support is included.