Apache Airflow

AWS Azure Analytics 2 variations

Apache Airflow with a local metadata database and executor, ready to author and schedule data pipelines on launch.

Base
Hardened build
minimal ports, security patches applied at build time
Access
Unique credentials
generated on first boot, readable only by root
Verified
Boots working
services pass a health gate before release
Support
24/7, 365 days
by email and live chat, 24 hour response SLA

Variations

Choose the operating system, cloud and version you need. Every variation is the same hardened Apache Airflow image, built and supported by cloudimg.

ProductCloudOperating systemVersion
Apache Airflow - Workflow Orchestration AWS Standard View · Guide
Apache Airflow 3.2 on Ubuntu Azure Ubuntu 3.2 View · Guide

Overview

Apache Airflow is a platform for authoring, scheduling and monitoring workflows as code, widely used to orchestrate ETL and data engineering pipelines. Workflows are defined as Python DAGs and tracked through a web interface.

Why the cloudimg image

Airflow is preinstalled with a local PostgreSQL metadata database and the LocalExecutor, hardened and ready with no manual setup. Fresh PostgreSQL and Airflow administrator passwords are generated on first boot for every instance and stored in a root only file, so there is no default login, and 24/7 cloudimg support covers deployment, upgrades and DAG authoring.

Common uses

  • Data pipeline orchestration
  • Scheduled ETL workflows
  • Batch job scheduling