AnythingLLM on Ubuntu 24.04 LTS by cloudimg

## AnythingLLM on Ubuntu 24.04 LTS by cloudimg

AnythingLLM is an all-in-one AI application from Mintplex Labs that lets you chat with your documents using retrieval-augmented generation (RAG), organise conversations into workspaces and share access across a team with full multi-user controls. This cloudimg image installs AnythingLLM 1.14.1 on Node.js 20 LTS, runs it behind an nginx reverse proxy on port 80, stores its database, vectors and uploads on a dedicated Azure data disk, and generates a unique admin account on the first boot of every VM. Backed by 24/7 expert support.

Chat With Your Documents

Retrieval-augmented generation over your own documents, organised into workspaces, with full multi-user controls. A built-in native embedder means upload and search work without any external provider.

Bring Your Own LLM

The app and admin panel are fully functional out of the box; chat needs an LLM provider, which you supply on first use - choose OpenAI, Anthropic or a local Ollama in Settings, LLM Preference.

Dedicated Data Disk

The LanceDB vector store, the SQLite metadata store and uploaded documents live on a dedicated, independently resizable Azure data disk mounted at /var/lib/anythingllm, re-provisioned with every VM.

Secure First Boot

Multi-user mode is enabled with a unique admin account generated on the first boot of every VM, written to a root-only credentials file. No shared credentials ship in the image.

Why Choose cloudimg?

* 24/7 Expert Support with guaranteed 24 hour response. Contact support@cloudimg.co.uk

* Production Ready from Launch Pre configured, security patched, and validated before publication

* Azure Native Integration Built with Azure Linux Agent, cloud init, and Gen2 Hyper V

What is Included

* AnythingLLM 1.14.1 served on port 80 via nginx (WebSocket upgrade, 1 GB upload limit)

* Built-in LanceDB vector store and SQLite metadata store

* A dedicated Azure data disk at /var/lib/anythingllm for the database, vectors and uploads

* Multi-user mode with a unique per-VM admin generated on first boot

* anythingllm.service, anythingllm-collector.service and nginx.service as systemd units

Getting Started

Retrieve the per-VM admin password with sudo cat /root/anythingllm-credentials.txt, browse to your VM on port 80 and sign in as admin. For public exposure, front port 80 with TLS and your own domain.

Use Cases

Self-hosted document Q&A and RAG, a private team AI workspace, knowledge-base chat over your own files, and an on-prem AI app that keeps your documents in your environment.

Visit www.cloudimg.co.uk/guides/anythingllm-on-ubuntu-24-04-azure for the full user guide.

AnythingLLM is a trademark of Mintplex Labs Inc.; cloudimg is not affiliated with or endorsed by Mintplex Labs. All trademarks are the property of their respective holders.