Hardened Ollama, LiteLLM and Self Hosted LLM Server AMIs on AWS: Guide

Overview

This page is the entry point for the cloudimg Hardened Ollama, LiteLLM & Self Hosted LLM Server AMIs AWS Marketplace listing. The listing is a single product that offers several products and releases as separate software versions. Subscribe once, then choose the version you want from the Software version list at launch, and open its guide below for the full setup and connection walk-through.

What cloudimg adds to every version - Every image is built by cloudimg on a fully patched base with the latest security updates applied at build time. - Each product is CPU-only (no GPU drivers or CUDA libraries ship), generates its administrator password, API keys and secrets uniquely on the first boot of each instance, serves its web interface or API over HTTPS with a per-instance certificate, and its services cannot reach the instance metadata service, so a prompt or a configured URL can never fetch the instance's credentials.

Pricing is metered hourly per EC2 instance type and is the same for every version in this listing. The recommended instance type is m5.large.

How to pick a version

1. Open the listing on AWS Marketplace and choose View purchase options, then Subscribe. One subscription covers every product and release in the listing, and the free trial starts with it.
2. Once the subscription is active, choose Launch your software.
3. Choose One-click launch from AWS Marketplace (or Launch from EC2 Console for full control), then in Version choose the product and release you want. Each version is a separate software version, named <product> <release> on <operating system> - <date>, for example LiteLLM 1.88.0 on Ubuntu 24.04 - YYYY-MM-DD. The date is when that version was added to the listing.
4. Choose your Region and an instance type (m5.large is recommended), your EC2 key pair and a security group that opens the ports in the product's guide, then choose Launch.
5. After launch, open the product's guide below for first login.

You can run several products from the same subscription: launch one instance per product, each from its own software version.

Versions in this listing, newest release first:

• LiteLLM: 1.88.0 on Ubuntu 24.04

Security model

Every version in this listing follows the same model:

• No default login. Administrator passwords, database passwords and application secrets are generated on the first boot of each instance and written to a root-only file. No two instances share a secret.
• Only the documented ports. Each guide lists the ports the product needs; open only those in your security group.
• Internal services on localhost. Databases and caches listen on 127.0.0.1 only. Never open database ports (3306, 5432, 6379) to the internet.
• Patched base. The operating system is fully patched when the image is built.
• HTTPS on first boot for LiteLLM 1.88.0 on Ubuntu 24.04: these versions serve HTTPS with a per-instance certificate from first boot. The other versions serve HTTP; their guide shows how to add a certificate on the instance or behind an Application Load Balancer with AWS Certificate Manager.

Choose your product

How to tell which version you launched

The version you chose is shown on the instance's launch record in the EC2 console (AMI name and description) and in your AWS Marketplace subscription. On the instance itself, the login message after SSH names the product and its credentials file. Open the matching guide above for the rest of the walk-through.

Support

cloudimg provides 24/7 support for every version in this listing via the AWS Marketplace support channel. Raise a ticket through the Marketplace console or email support@cloudimg.co.uk.

All product and company names are trademarks or registered trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.