Explains why kcat (kafkacat) may show incorrect Kafka topics due to config file priority overriding CLI arguments.
A technical tutorial on using Apache Flink SQL to explore and process real-time flood monitoring data from a government API, demonstrating data wrangling techniques.
A former Debezium lead argues that Change Data Capture (CDC) is a feature within larger data platforms, not a standalone product.
A developer troubleshoots a connection issue when using ngrok to expose a local Kafka service, ultimately discovering a DNS-related problem.
A monthly roundup of news and resources on stream processing, Apache Flink, Kafka, and data engineering from industry experts.
A tutorial on building a Golang producer and consumer with Kafka using the segmentio/kafka-go library.
A technical guide on configuring a data pipeline from Kafka to Elasticsearch using Logstash, including Docker setup and configuration examples.
Guide to selecting hardware for Kafka brokers, covering disk throughput, capacity, memory, networking, and CPU optimization.
![[KAFKA] Consumers and Consumer Groups](https://crawljobs-blogs-media.s3.us-east-1.amazonaws.com/alldevblogs/thumbs/article-4eaa9118d2f6-full-02c96341.webp)
Explains Kafka consumers and consumer groups, scaling consumption by adding consumers to handle high message loads.
Guide to constructing a Kafka producer with mandatory properties and message sending methods.
Overview of Kafka producer API, covering use cases, configuration, and message sending process.
![[KAFKA] How to chose the number of partitions?](https://crawljobs-blogs-media.s3.us-east-1.amazonaws.com/alldevblogs/thumbs/article-86505126ff65-full-f0f2e0ea.webp)
A guide on choosing the optimal number of Kafka partitions based on throughput, consumer speed, and future scaling.
Explores strategies for handling Kafka message delivery failures in applications, discussing trade-offs between consistency and availability.
Explores strategies for handling Kafka producer failures, focusing on trade-offs between consistency and availability in messaging systems.
A guide to implementing reliable Apache Kafka producers and consumers in .NET, covering delivery models and idempotency.
An analysis of key trends in the Apache Kafka ecosystem, including connector growth, self-service data pipelines, and stream processing adoption.
An analysis of current trends in the Apache Kafka ecosystem, focusing on connector growth, self-service data pipelines, and stream processing adoption.
A technical guide on using kafkacat to load static CSV data into Apache Kafka topics for data enrichment, focusing on simplicity over Kafka Connect.
A technical guide on using Unix pipelines with curl, xq, and kafkacat to ingest and transform XML data into JSON for Kafka.
Introduction to ingesting XML data into Kafka, covering challenges and approaches for handling XML schemas in Kafka topics.
