Some of my favourite public data sets
A developer shares a list of UK-centric public and open data sources for building realistic applications and demos.
Robin Moffatt is a Principal DevEx Engineer and seasoned conference speaker with 15+ years of experience presenting at top events like QCon, Devoxx, Kafka Summit, and Strata. He shares insights on developer experience, distributed systems, and cloud technologies through his blog, YouTube, and public talks.
617 articles from this blog
A developer shares a list of UK-centric public and open data sources for building realistic applications and demos.
A curated collection of Apache Kafka and ksqlDB talks, including recordings, slides, and code examples for building streaming data pipelines.
A technical guide on setting up ksqlDB with embedded Kafka Connect to ingest CDC events from MS SQL Server using the Debezium connector via Docker Compose.
A technical guide on using Asciidoc's include directive within Hugo to embed external code snippets from sources like GitHub.
An overview of Kafka Connect, Apache Kafka's integration API, covering its features, resources, and use cases for data pipelines.
Explores methods to count messages in a Kafka topic, comparing kafkacat commands with wc to ksqlDB for more detailed, grouped aggregations.
A technical guide on managing and cleaning up custom search engines in Google Chrome by directly manipulating its SQLite database.
Explains the BOT_COMMAND_INVALID error in Telegram bots, showing that commands must be lowercase when using the setMyCommands API.
A technical guide on processing chunked HTTP responses in Go to handle streaming JSON data from a database without waiting for EOF.
A developer shares their journey learning Go by building a utility to check Apache Kafka's advertised.listeners configuration for common issues.
A guide to organizing Go code by splitting functions into separate source files and building a standalone binary executable.
A developer's notes on learning Go by building a Kafka utility, focusing on error handling, command-line arguments, and goroutines.
Explores using the Kafka AdminClient API in Go, covering context usage for timeouts and basic cluster metadata operations.
A tutorial on implementing a function-based Kafka consumer in Go, moving from the deprecated channel-based approach.
A developer's notes on implementing a Kafka consumer in Go using the deprecated channel-based API, including code examples and termination patterns.
A technical guide on implementing error handling and type assertions for a Kafka producer written in Go.
A technical tutorial on creating a basic Kafka producer in Go, highlighting initial setup and code with minimal error handling.
A developer's journey learning to use the Go programming language with Apache Kafka, starting with the Confluent Go client.
A developer's notes on implementing a concurrent web crawler in Go, covering mutexes, wait groups, and avoiding duplicate URL fetching.
Explains the difference between JSON and JSON Schema serialization in Kafka Connect, showing the extra bytes in the wire format using hexdump.