OLake on Ubuntu 24.04 LTS

Overview

OLake is a data replication platform that continuously moves data out of operational databases such as PostgreSQL, MySQL, MongoDB, Oracle and SQL Server and lands it in Apache Iceberg or as Parquet in object storage, where analytics engines can query it. It supports both full refresh loads, which copy a table in its entirety, and change data capture, which reads the database write ahead log so that inserts, updates and deletes stream into the lakehouse continuously without repeatedly rescanning the source.

Everything is driven from a web console: register a source, register a destination, discover the tables and columns available, choose which streams to replicate and in which mode, then run the job and watch its history. Each sync runs as an isolated connector process, so a large table replication cannot destabilise the console, and job runs, schedules and logs are all visible in one place. It suits teams building a lakehouse on open table formats, anyone offloading analytical queries away from a production database, and engineers who want an ingestion pipeline they run inside their own cloud account rather than a managed service.

Common uses

• Replicate operational databases into an Apache Iceberg or Parquet lakehouse
• Stream inserts, updates and deletes with change data capture
• Offload analytical queries away from a production database

See it running

Real screenshots taken while testing this image against its deployment guide.