OpenSearch Log Stack with Fluent Bit on Ubuntu 24.04 LTS

Overview

OpenSearch Log Stack with Fluent Bit is a working log pipeline in a single virtual machine, assembled from three Apache 2.0 projects that are designed to run together. Fluent Bit, the CNCF graduated log and metrics processor, reads the system journal and any log file dropped into a watched directory, stamps every record with the host it came from, and ships it over an encrypted local connection into OpenSearch. OpenSearch stores those records as daily indices and exposes its full search and aggregation API. OpenSearch Dashboards, the companion web interface, is where you run queries, build visualisations and assemble dashboards over everything that has been collected.

It suits teams who want their own log search rather than a metered hosted service: application and access logs from a handful of servers, output from containers or appliances, audit trails that have to stay inside your own network, or a development environment where engineers need to search across services quickly. Because collection, storage and the user interface ship together and are already wired to each other, there is no pipeline to design before the first query returns.

Common uses

• Centralise application and system logs from a small fleet into one searchable index
• Give engineers a private log search and dashboard tool that keeps data inside your own network
• Stand up a working log pipeline for a development or test environment in minutes

See it running

Real screenshots taken while testing this image against its deployment guide.