Dragonfly P2P Distribution on Ubuntu 24.04

Overview

Dragonfly is an open source, cloud native peer to peer (P2P) file and container image distribution system, a graduated project of the Cloud Native Computing Foundation. It turns the machines that pull artifacts into a swarm that shares pieces with each other, so a large image, model file or dataset is fetched from the origin once and then spread P2P across peers. This slashes origin bandwidth, speeds up mass rollouts and keeps registries and object stores from being overwhelmed when thousands of hosts pull the same content at once.

Dragonfly is built from four cooperating parts: a manager that provides the control plane and web console, a scheduler that plans which peer fetches which piece from whom, a seed peer that fetches from the origin and seeds the swarm, and a peer agent with a dfget command line and an HTTP proxy for pulling content through the P2P network. This appliance runs all of them together on a single machine, backed by a bundled database and cache, giving you a complete, ready to run Dragonfly cluster you can use on its own or grow into a multi node deployment.

Common uses

• Accelerating container image and artifact pulls across large fleets
• Distributing AI model files and large datasets without overloading the origin
• A self contained content distribution cluster for registries and object stores

See it running

Real screenshots taken while testing this image against its deployment guide.