Tech Meetup Glasgow - Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with OpenTelemetry (slides)

Today I was with my friends at the Tech Meetup in Glasgow, where I mentioned previously I'd be bringing a hands-on session on mastering Fluent Bit.

Last time over a year ago I was here to share insights into OpenTelemetry, but this time I wanted to bring a new project to the stage: Fluent Bit.

This meetup started in the Edinburgh area, but expanded into the Glasgow tech community. It welcomes people with all levels of experience, even if you are starting your journey into tech as a student, boot camper, or you're thinking of starting your development career, you are more than welcome.

I spent the evening sharing an introduction to Fluent Bit pipelines and OpenTelemetry Collector and most of the session on live demoing the complete integration story to showcase it from front to back.

My slides from the talk are available online below.

The slides include links and QR codes taking you to the free online workshop that I mentioned in the session. That is where you too can work through the content and run all the examples I shared on your own local machine.

For completeness, the title and abstract of my talk.

Mastering Fluent Bit: Ultimate Guide to Integrating Telemetry Pipelines with OpenTelemetry

It's time you stopped letting your telemetry data pressure your budgets and get in the way of  solving issues with agility! No more I say! Take back control of your telemetry data as we guide you through the open source project Fluent Bit. Learn how to manage your telemetry  data from source to destination using the pipeline phases covering collection, parsing, aggregation, transformation, and forwarding from any source to any destination. Buckle up for a fun ride as you learn by exploring how telemetry pipelines work, how to set up your first pipeline, and exploring several common use cases that Fluent Bit helps solve. All this backed by a self-paced, hands-on workshop that attendees can pursue at home after this session (https://o11y-workshops.gitlab.io/workshop-fluentbit).

Talk includes 15 mins of live demoing the following integration phases:

• collecting telemetry data with Fluent Bit, enriching and securing, then passing to output destination.
• exposing Fluent Bit collected data as metrics endpoint, collecting, and displaying with Prometheus.
• collecting telemetry data with Fluent Bit, putting into OpenTelemetry (OTLP) format, then passing to output destination.
• collecting telemetry data with Fluent Bit, putting into OpenTelemetry (OTLP) format, then passing to OpenTelemetry Collector.
• collecting telemetry data with Fluent Bit, putting into OpenTelemetry (OTLP) format, then passing to OpenTelemetry Collector, finally sending it to storage for later usage.

Thanks to all who showed up for the evening and chatted with me afterwards, I always enjoy this meetup and it remains one of my favorite places to test out my newest ideas.