Cloud Native Manchester: Exploring the Power of Open Source Telemetry Pipelines, Fluent Bit Edition (slides)

 

As I mentioned previously, I was going to speak in June at Cloud Native Manchester, but due to transit strikes in my country I was unable to make the trip over to Manchester. 

The meetup is described as, "A Northern outpost for all things Cloud Native - from Kubernetes to Etcd and everything in between... If you're interested in container orchestration and all its surrounding ecosystem, then we welcome you onboard!"

Tonight I shared a rather ambitious session where, after introducing the concepts of telemetry pipelines, I let the meetup attendees choose from a list of five examples (demo scenarios). I then proceeded to share live on stage the details of how things work; Fluent Bit pipelines, integration with OpenTelemetry, integration with Prometheus, controlling logs in a Kubernetes cluster, and AI observability. 

As promised, I wanted to share both the slides and talk details below.

The slides are available online:

The talk details:

Exploring the Power of Open Source Telemetry Pipelines, Fluent Bit Edition

It’s time you stopped letting your telemetry data pressure your budgets and get in the way of solving issues with agility! No more I say! Take back control of your telemetry data as we guide you through the open source project Fluent Bit. Learn how to manage your telemetry data from source to destination using the pipeline phases covering collection, parsing, aggregation, transformation, and forwarding from any source to any destination. Buckle up for a fun ride as you learn by exploring how telemetry pipelines work, how to set up your first pipeline, and exploring several common use cases that Fluent Bit helps solve as you integrate with OpenTelemetry collectors in your organization. All this backed by a self-paced, hands-on workshop that attendees can pursue at home after this session (https://o11y-workshops.gitlab.io/workshop-fluentbit).

Talk includes live demoing of some of the following (viewers choice):

• collecting telemetry data with Fluent Bit, enriching and securing, then passing to output destination.
• collecting Fluent Bit metrics and displaying them with Prometheus.
• integrating Fluent Bit with OpenTelemetry.
• exploring logs collection and control with Fluent Bit on Kubernetes clusters.
• preview collecting AI workload (LLM) metrics, logs, and traces with Fluent Bit. 

This is going to be a trial session where I'm bringing a lot of hands-on and live demo content together and letting the attendees choose what they find most interesting. Please join us if you are in the area as I am excited to get some feedback on this session format!