Robin Moffatt • 6/17/2018

Analysing Network Data with Apache Kafka, KSQL, and Elasticsearch

This article details a practical implementation of stream processing using Apache Kafka, KSQL, and Elasticsearch. The author demonstrates how to ingest network event data from a Ubiquiti router via syslog and device data from MongoDB via Debezium, enrich the streams with KSQL, and visualize the data in Kibana. The analysis reveals an anomaly where a WiFi plug repeatedly reconnects during an internet outage, leading to a proposal for building an automated alerting system using KSQL for real-time pattern detection.

0 comments

#data analysis #Elasticsearch #Apache Kafka