Base
Hardened build
minimal ports, security patches applied at build time
Apache Spark
AWS
Azure
Analytics
2 variations
Apache Spark 4 as a fully configured single node cluster, accepting analytics jobs within minutes of launch.
Variations
Choose the operating system, cloud and version you need. Every variation is the same hardened Apache Spark image, built and supported by cloudimg.
| Product | Cloud | Operating system | Version | |
|---|---|---|---|---|
| Apache Spark Single-Node Cluster | AWS | — | Standard | View · Guide |
| Apache Spark 4.1 on Ubuntu | Azure | Ubuntu | 4.1 | View · Guide |
Overview
Apache Spark is a distributed analytics engine for large scale batch, SQL and streaming data processing. This image runs a standalone single node cluster with the master and worker supervised by systemd, and Java 17 and Python 3 version matched for spark submit, spark sql, spark shell and PySpark.
Why the cloudimg image
The cluster is preconfigured and hardened, restarting its processes automatically with no external orchestrator, and a dedicated data volume keeps shuffle data and logs off the operating system disk. cloudimg provides 24/7 support covering cluster configuration, job tuning and enabling TLS and authentication.
Common uses
- Big data processing
- Spark SQL and ETL
- PySpark data engineering
More in Analytics
Aw
Ackee
Analytics
Ackee, self hosted, privacy friendly web analytics, hardened and ready to track sites on Ubuntu 24.04.
Apache Airflow
Analytics
Apache Airflow with a local metadata database and executor, ready to author and schedule data pipelines on launch.
Apache DolphinScheduler
Analytics
Apache DolphinScheduler, a visual workflow orchestration platform, ready to schedule data pipelines on first boot.
Ad
Apache Drill
Analytics
Apache Drill, the schema free SQL query engine, ready to query files and stores on first boot.
Apache Flink
Analytics
Apache Flink with JobManager, TaskManager and the web dashboard, ready to run stateful stream processing jobs.
Apache Hadoop
Analytics
Apache Hadoop, the distributed storage and processing platform, ready for big data workloads on first boot.