Base
Hardened build
minimal ports, security patches applied at build time
Rucio on Ubuntu 24.04 LTS
Azure
Storage
Rucio, the scientific data management system born at CERN, organising, locating and moving very large volumes of data across distributed storage from one catalogue and API.
Overview
Rucio is an open source framework for managing scientific data at scale. It keeps a single catalogue of your data files, records which storage systems hold each copy, and lets you find, upload, download and move data through one consistent API and command line client. Data is addressed by a logical name inside a namespace rather than by a physical path, so a file, or a whole dataset grouping many files, can be located and retrieved no matter which storage element actually holds it.
Around that catalogue Rucio adds the concepts a large collaboration needs: storage elements that represent each place data can live, accounts and scopes that separate whose data is whose, quotas that bound how much each account may store, and replication rules that express how many copies of a dataset should exist and where. It is the system that some of the largest scientific experiments in the world use to steer many hundreds of petabytes across globally distributed storage, and it runs just as well as a single self contained node for evaluation, development and smaller archives.
Why the cloudimg image
Rucio is powerful but involved to stand up: it wants a database backend, an initialised catalogue, a bootstrapped root account, at least one storage element with a working transfer protocol, a scope and a quota before a single file can be registered. cloudimg does all of that for you and hands over a server that already works. The catalogue database is bundled and kept on the internal network only, never exposed. The catalogue is initialised and a local storage element is created and granted quota on the first boot of every instance, so you can register, upload, list and locate a data file immediately. There is no default login in the image: both the database password and the administrator password are generated uniquely on first boot and written to a file only root can read, and the well known upstream demonstration credential is proven to be refused. The image is fully patched with unattended security upgrades enabled, ships a self test that authenticates and runs a real upload and list round trip, and every deployment is paired with a step by step deploy guide and backed by 24/7 cloudimg support.
Common uses
- Catalogue and locate scientific data across distributed storage
- Register, upload and list data files through one API and client
- Evaluate and develop against a working single node Rucio server
More in Storage
A1
AIStore 1.4 Scalable Object Storage for AI and ML Datasets on Ubuntu 24.04 LTS
Storage
AIStore is an open source object storage system from NVIDIA, built for the read heavy, high throughput access patterns o...
Alfresco Community Edition on Ubuntu 24.04 LTS
Storage
Alfresco Community Edition is an open source enterprise content management platform.
Apache Ozone on Ubuntu 24.04 LTS
Storage
Apache Ozone is the scalable, distributed object store for Hadoop and cloud-native workloads. It exposes both an S3-comp...
ArozOS on Ubuntu 24.04 LTS
Storage
ArozOS on Ubuntu 24.04 LTS preconfigured machine image for Microsoft Azure, hardened and verified with 24/7 support by c...
Backrest on Ubuntu 24.04 LTS
Storage
Backrest is a popular open source web interface and orchestrator for restic, the fast, secure, deduplicating backup prog...
Bacula on Ubuntu 24.04 LTS
Storage
The image installs Bacula 13.0.4 from the Ubuntu 24.04 archive and runs the Director, a Storage Daemon writing to a file...