Base
Hardened build
minimal ports, security patches applied at build time
vLLM
Azure
Artificial Intelligence (AI)
1 variation
vLLM, a high throughput OpenAI compatible inference and serving engine for large language models, secured and ready to serve from first boot.
Variations
This product is available in the build below. Open it for the operating system, cloud and version detail, or read its deployment guide.
| Product | Cloud | Operating system | Version | |
|---|---|---|---|---|
| vLLM on Ubuntu 24.04 LTS | Azure | Ubuntu 24.04 | Standard | View · Guide |
Overview
vLLM is a high throughput, memory efficient inference and serving engine for large language models. Its PagedAttention scheduler delivers leading serving throughput and it exposes an OpenAI compatible REST API, so existing OpenAI client code works unchanged against a private, self hosted inference backend for open weight models.
Why the cloudimg image
cloudimg ships vLLM hardened and fully patched, with the inference server bound to loopback behind an nginx TLS proxy that enforces a unique API key generated on first boot into a root only file. A paired deployment guide and 24/7 support are included with every image.
Common uses
- High throughput LLM inference
- Private self hosted model serving
- OpenAI compatible API backend
More in Artificial Intelligence (AI)
Argilla
Artificial Intelligence (AI)
Argilla, an open source data annotation and curation platform for building high quality datasets for natural language pr
Bifrost
Artificial Intelligence (AI)
one OpenAI compatible endpoint in front of every model provider, packaged by cloudimg
ContextForge MCP Gateway
Artificial Intelligence (AI)
ContextForge, the open source model context protocol gateway from IBM: federate many MCP servers behind one authenticate
Crawl4AI
Artificial Intelligence (AI)
an open source web crawler that turns any web page into clean, LLM ready markdown over a REST API, secured from first bo
Do
DeepWiki-Open
Artificial Intelligence (AI)
turn any Git repository into a browsable, AI generated wiki
Dify
Artificial Intelligence (AI)
Dify, a source available platform for building LLM apps, agents, RAG and workflows from a visual console.