Robin Moffatt • 4/16/2020

A quick and dirty way to monitor data arriving on Kafka

This article details a simple, hacky solution for monitoring data flow into Apache Kafka. It uses kafkacat to poll the latest message timestamp, jq for extraction, and a bash script to check against a threshold. If the data is stale, it sends an alert via a Telegram bot, providing a lightweight monitoring setup for unstable data sources like a Raspberry Pi running tshark.

0 comments

#bash #Monitoring #Scripting