Apache Kafka

This is a repackaged open source software product wherein additional charges apply for cloudimg support services.

Overview

Apache Kafka is the leading open source distributed event streaming platform, used to build real time data pipelines and streaming applications. This image delivers Kafka fully installed and configured in KRaft mode, so a complete event streaming broker is running within minutes of launch. The current release available is Kafka 4.x.

Streaming Stack

Apache Kafka running as a single combined broker and controller in KRaft mode, with no ZooKeeper dependency. OpenJDK 17. A dedicated systemd service runs the broker as an unprivileged user. The standard Kafka command line tools are on the system path for producing, consuming and administering topics. A bundled web management console gives operators Topics, Nodes and Consumer Groups views in the browser, fronted by an nginx reverse proxy.

Secure First Boot

On the first boot of your instance a one shot service generates a fresh broker administrator password, unique to that instance, and bakes it into the KRaft cluster metadata as a SASL SCRAM SHA 256 credential. The same password protects the web management console through HTTP basic authentication. The generated credentials are written to a root only file. No shared or default credentials ship in the image.

Ready To Use

The broker, the controller quorum, the web management console and the nginx proxy are all configured and start automatically. A sample topic is created on first boot. Browse to the instance address to reach the web console, or connect a Kafka client to the broker on port 9092 using the generated SASL credentials.

Production Grade Storage

Kafka log directories and cluster metadata are stored on a dedicated EBS data volume, separate from the operating system disk and independently resizable, with the mount pinned by filesystem identifier so it survives every reboot.

cloudimg Support

24/7 technical support by email and chat. Help with Kafka deployment, broker tuning, topic and partition design, consumer group management and scaling to a multi broker cluster.

Use Cases

Real time data pipelines and stream processing. Event driven microservice communication. Log and metric aggregation. Edge and IoT message brokering. Proof of concept and development clusters.

All product and company names are trademarks or registered trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.