Base
Hardened build
minimal ports, security patches applied at build time
Infinity Embeddings
AWS
Artificial Intelligence (AI)
1 variation
The Infinity GPU server for text embeddings and reranking, with an OpenAI compatible API on port 80.
Variations
This product is available in the build below. Open it for the operating system, cloud and version detail, or read its deployment guide.
| Product | Cloud | Operating system | Version | |
|---|---|---|---|---|
| Infinity Embeddings Server | AWS | — | Standard | View · Guide |
Overview
Infinity is a high throughput GPU server for text embeddings and reranking with an OpenAI compatible API. It serves sentence transformer models for retrieval augmented generation and vector search.
Why the cloudimg image
cloudimg preinstalls Infinity behind an nginx reverse proxy with the NVIDIA datacenter driver verified on real hardware, so embeddings run on the GPU on g4dn, g5 and g6 instances out of the box. A unique HTTP Basic password is generated on first boot with no default login, backed by 24/7 support.
Common uses
- Embeddings generation
- Retrieval augmented generation
- Reranking and vector search
More in Artificial Intelligence (AI)
AnythingLLM
Artificial Intelligence (AI)
An all in one document chatbot and RAG workspace, ready to ingest and answer over your own files on launch.
Di
Dify
Artificial Intelligence (AI)
Dify, a source available platform for building LLM apps, agents, RAG and workflows from a visual console.
Flowise
Artificial Intelligence (AI)
A visual low code builder for AI agents and LLM workflows, ready to run behind a unique login on first boot.
In
Infinity
Artificial Intelligence (AI)
Serve text embeddings and reranking privately, behind one API with a per VM credential and no default login.
Ls
Label Studio
Artificial Intelligence (AI)
The Label Studio data labeling platform for machine learning, secured behind nginx with per instance credentials.
LibreChat
Artificial Intelligence (AI)
A private, multi provider LibreChat AI chat platform preconfigured with MongoDB, nginx and unique per instance secrets.