LiteLLM preinstalled for AWS. The open source OpenAI-compatible gateway for 100+ LLM providers, on Python 3.12 and Ubuntu 24.04, gated by a unique master key generated on first boot. Backed by 24/7 cloudimg support.
## LiteLLM by cloudimg
LiteLLM puts a single OpenAI-compatible API in front of more than 100 large language model providers, including OpenAI, Anthropic, Amazon Bedrock, Azure OpenAI and self hosted models, with load balancing, fallbacks, rate limiting, virtual keys and spend tracking. This Amazon Machine Image delivers the LiteLLM proxy fully installed as a system service, so a production ready LLM gateway is running within minutes of launch. The release available is LiteLLM 1.88.
## Secure First Boot
The proxy is gated by a master key generated uniquely for every instance on first boot and written to a root only file. No shared or default key ships in the image.
## Ready To Use
Add your provider credentials to /etc/litellm/config.yaml, point your application's OpenAI base URL at the instance on port 80, and call any configured model through one API. Because LiteLLM calls out to external model endpoints, the image is CPU only.
## cloudimg Support
cloudimg provides 24/7 technical support for this image, covering deployment, providers and model routing, load balancing and fallbacks, virtual keys and budgets, TLS and scaling.