Apache Airflow

Azure Applications 1 variation

Apache Airflow 3.2 on Ubuntu, author and schedule data pipelines as code.

Base
Hardened build
minimal ports, security patches applied at build time
Access
Unique credentials
generated on first boot, readable only by root
Verified
Boots working
services pass a health gate before release
Support
24/7, 365 days
by email and live chat, 24 hour response SLA

Variations

This product is available in the build below. Open it for the operating system, cloud and version detail, or read its deployment guide.

ProductCloudOperating systemVersion
Apache Airflow 3.2 on Ubuntu Azure Ubuntu 3.2 View · Guide

Overview

Apache Airflow is the open source platform for authoring, scheduling and monitoring workflows defined in Python. Data and platform teams use it to orchestrate pipelines, from moving and transforming data to running machine learning jobs, with a web interface that shows every run and its history.

This image provides a running Airflow ready for you to add your workflow definitions and start scheduling.

Why the cloudimg image

The cloudimg image installs Airflow on a hardened Ubuntu base with the web interface secured by a password generated uniquely for your instance on first boot and stored in a root only file. The deployment guide covers first login, adding your first pipeline and enabling HTTPS, so you begin with a working scheduler rather than a manual install. 24/7 support is included.

Common uses

  • Orchestrating data pipelines and scheduled batch jobs
  • Coordinating extract, transform and load workflows as code
  • Scheduling and monitoring machine learning and reporting tasks