Ollama on Ubuntu 24.04 LTS

Name: Ollama on Ubuntu 24.04 LTS
Brand: cloudimg

Azure Artificial Intelligence (AI)

Run open large language models privately, behind one API with a per VM credential and no default login.

Base

Hardened build

minimal ports, security patches applied at build time

Access

Unique credentials

generated on first boot, readable only by root

Verified

Boots working

services pass a health gate before release

Support

24/7, 365 days

by email and live chat, 24 hour response SLA

Overview

Ollama is an open source runtime that downloads, quantizes and serves large language models such as Llama, Mistral, Gemma and Qwen behind a single REST API that is also OpenAI compatible. You pull a model with one command and call it from your own applications or the CLI.

Why the cloudimg image

The Ollama server is bound to loopback and fronted by an nginx TLS proxy that enforces HTTP Basic auth, so nothing is reachable without a credential. A fresh admin password and TLS certificate are generated on first boot into a root only file, so there is no default login. A small starter model is pre pulled so the API answers immediately, it runs on CPU and offloads to the GPU when one is present, and 24/7 cloudimg support plus a paired deploy guide are included.

Common uses

Private self hosted LLM endpoint
OpenAI compatible backend for RAG and agents
Offline and air gapped model serving

Overview

Why the cloudimg image

Common uses

More in Artificial Intelligence (AI)

AnythingLLM

Infinity Embeddings Server

Label Studio

LibreChat AI Chat Platform - with

LiteLLM

LocalAI