Robin Moffatt 10/1/2020

Ingesting XML data into Kafka - Option 1: The Dirty Hack

Read Original

This article details a 'dirty hack' method for ingesting XML data into Apache Kafka. It demonstrates using a Unix pipeline with curl to fetch XML from a REST API, xq to convert XML to JSON, and kafkacat to produce the transformed records to a Kafka topic. The tutorial includes specific commands and logic for parsing and denormalizing the XML structure, positioning it as a rapid prototyping solution rather than production-ready code.

Ingesting XML data into Kafka - Option 1: The Dirty Hack

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week