Robin Moffatt • 10/1/2020

Ingesting XML data into Kafka - Option 1: The Dirty Hack

This article details a 'dirty hack' method for ingesting XML data into Apache Kafka. It demonstrates using a Unix pipeline with curl to fetch XML from a REST API, xq to convert XML to JSON, and kafkacat to produce the transformed records to a Kafka topic. The tutorial includes specific commands and logic for parsing and denormalizing the XML structure, positioning it as a rapid prototyping solution rather than production-ready code.

0 comments

#json #xml #Kafka