Apache Flink and Prometheus: better together to improve the efficiency of your observability platform at scale

Prometheus has become the go-to solution for monitoring and alerting, ingesting metrics from applications and infrastructure. The ability to efficiently store high volumes of dimensional time series also makes Prometheus a perfect fit broader operational analytics use cases. Examples are observing fleets of IoT devices, connected vehicles, media streaming devices, and any distributed resources. However, the high cardinality and frequency of events generated by these sources be challenging. Apache Flink can preprocess observability events in real-time before writing to Prometheus. Reducing cardinality or frequency, adding contextual information, calculating derived metrics, will improve the efficiency of your observability platform. In this talk, an Apache Flink committer and the maintainer of the new open source Flink-Prometheus connector, will illustrate potential use cases, key challenges, and how to leverage Flink and Prometheus together to supercharge your observability platform.