Apache DolphinScheduler - Workflow Scheduler

This is a repackaged open source software product wherein additional charges apply for cloudimg support services.

# Why This DolphinScheduler AMI Over Self-Managed Apache DolphinScheduler is a powerful distributed, visual workflow and DAG scheduler for big-data and ETL pipelines - but standing it up by hand means provisioning a registry, a metadata database, the master, worker, API and alert services, then wiring them together and hardening the defaults. That process typically takes hours of dependency troubleshooting and configuration. This AMI eliminates that work entirely. You get a fully configured, ready-to-run DolphinScheduler environment within minutes of launch - no default credentials left in place, and no multi-service orchestration to assemble yourself. ## Who This Is For Data engineers, platform engineers, and DevOps teams who need a production-grade workflow scheduler without the overhead of manual installation. Whether you are orchestrating nightly ETL ingestion of millions of records from S3 into Redshift with retry logic and Slack alerts, coordinating Spark jobs across a data lake, or scheduling ML training pipelines - this AMI gives you a running scheduler faster than writing a Docker Compose file. ## Application Stack - Apache DolphinScheduler deployed as the all-in-one standalone server, bundling the master, worker, API server, alert server and the visual web UI in a single managed JVM service

• Java 17 runtime from the operating system distribution, no third-party package repository
• Embedded metadata database persisted to a dedicated EBS data volume so projects, workflow definitions and run history survive reboots and re-launches
• nginx reverse proxy on port 80 fronting the application, with an unauthenticated health endpoint for load-balancer checks
• systemd-managed services running under a dedicated unprivileged service account with automatic restart on failure ## Security and Hardening Unique Credentials Per Instance: On first boot, a one-shot service rotates the shipped default administrator password to a fresh value unique to that instance and writes it to a root-only file. No shared or default credentials remain usable in the running image - eliminating the credential-sharing risk common with other marketplace AMIs that ship with admin/admin or similar defaults. Loopback-Bound Application: The DolphinScheduler listener binds to localhost only and is reached exclusively through the nginx reverse proxy, reducing the exposed surface. The application enforces its own username and password authentication. Dedicated Data Volume: All scheduler state lives on a separate, independently resizable EBS volume rather than the OS disk, so data and system lifecycle are cleanly separated. Network Security Guidance: Configure your EC2 security group to restrict port 80 to trusted IP ranges, or place the instance behind an Application Load Balancer with TLS termination for encrypted access to the web UI. Enable EBS encryption on your volumes for data-at-rest protection. ## Getting Started 1. Launch the AMI on your chosen instance type (an m5.large or larger is recommended for production workloads)

2. Ensure your security group allows inbound TCP on port 80 from your IP, and port 22 for SSH

3. Wait approximately 2-3 minutes for the first-boot credential rotation to complete

4. SSH into the instance and retrieve your credentials from the root-only file

5. Browse to http://your-instance-ip/ and sign in as the administrator

6. Create projects, author workflow definitions and schedule DAGs through the DolphinScheduler web interface ## Example Use Case: Nightly Data Warehouse Load A data engineering team schedules nightly ingestion of transaction records from Amazon S3 into Amazon Redshift. The DolphinScheduler DAG defines extraction, transformation, and load tasks with dependency edges, automatic retries on failure, and alert notifications via email or webhook when a task exceeds its SLA. The visual UI lets engineers monitor run status, drill into logs, and rerun failed branches - all without writing custom orchestration code. ## Additional Use Cases - Cross-system batch job orchestration and dependency management

• Machine learning training and data-processing task coordination
• Reporting workflow automation with scheduling and alerting ## About cloudimg cloudimg provides 24/7 technical support by email and live chat. Our engineers specialize in workflow-scheduler operations and provide expert assistance with DolphinScheduler deployment, upgrades, workflow authoring, task configuration, performance tuning and metadata database administration. Book a free 15-minute onboarding call to get personalized guidance for your use case. Apache DolphinScheduler and Apache are trademarks of the Apache Software Foundation.