Resetting a Consumer Group in Kafka
A guide on troubleshooting and resetting Kafka consumer group offsets when using Replicator to copy data between clusters.
Robin Moffatt is a Principal DevEx Engineer and seasoned conference speaker with 15+ years of experience presenting at top events like QCon, Devoxx, Kafka Summit, and Strata. He shares insights on developer experience, distributed systems, and cloud technologies through his blog, YouTube, and public talks.
625 articles from this blog
A guide on troubleshooting and resetting Kafka consumer group offsets when using Replicator to copy data between clusters.
A technical guide on manually migrating Alfred's clipboard history database between Macs using symbolic links and Dropbox.
An updated guide on creating technical diagrams using Concepts app on iPad, detailing a workflow for presentations and talks.
How to manually delete a Kafka Connect connector by writing a tombstone message to its internal config topic using kafkacat.
A technical guide on automating the restart of failed Kafka Connect tasks using bash scripts and the REST API.
A guide to securely externalizing secrets like passwords in Kafka Connect configuration using KIP-297 and the FileConfigProvider.
Explains how to delete a Kafka Connect connector by directly modifying its configuration topic when the REST API is unavailable.
A workaround technique for exploding arrays in ksqlDB using manual indexing, simulating EXPLODE/UNNEST functionality.
Explains the role of Kafka Connect converters, demonstrating that JSON source data doesn't automatically become structured messages.
A technical guide on how to read Kafka Connect offset data using the Confluent REST Proxy over HTTP, including example commands.
A technical tutorial on using CASE statements in ksqlDB to pivot and aggregate event stream data, similar to SQL PIVOT operations.
Guide on configuring KSQL to connect to a secured Confluent Cloud Schema Registry, including Docker setup and error troubleshooting.
A technical guide exploring stream-stream joins in KSQL using orders and shipments data, covering setup, aggregations, and join implementation.
A guide to terminating all running KSQL queries and dropping streams/tables using curl, jq, and xargs commands.
A developer advocate shares concise, opinionated advice for creating effective slide decks for tech conference talks, focusing on visual aids over content.
A technical guide demonstrating how to use the HTTPie command-line tool to produce and consume messages via the Confluent Kafka REST Proxy.
A Developer Advocate details the five-day process of creating a new tech conference talk, from procrastination to final preparation.
A developer advocate shares personal strategies for balancing frequent work travel with family life, based on eight years of experience.
Guide to configuring Kafka Connect logging, including changing log levels and redirecting output to files.
How to replace UTF-8 non-breaking spaces in Markdown files using sed on macOS, fixing formatting issues.