LiteLLM, a unified proxy for many LLM providers, ready to route AI requests through one API from first boot.
LiteLLM is a proxy and gateway that exposes a single, OpenAI compatible API across many large language model providers, with routing, spend tracking, and rate limiting. It is used to standardise and govern access to LLMs across an organisation.
cloudimg ships LiteLLM hardened and fully patched on Ubuntu 24.04 LTS, preconfigured so the proxy answers on first boot. A unique administrator credential is generated on first boot with no default login, and 24/7 support is included.