Category Archives: Distributed systems

Accessing Kafka on host machine from minikube pods

There are times when you want to access processes running on your host machine e.g. databases etc. from your minikube Kubernetes cluster in Virtual Box (or any other supported provider) For details, continue reading this blog on Medium Cheers!

Posted in Distributed systems, Kafka, Kubernetes | Tagged , , | Leave a comment

Kafka Streams Interactive Queries

This blog post explores the Interactive Queries feature in Kafka Streams with help of a practical example. It covers the DSL API and how the state store information was exposed via a REST service For details, check out the blog post on … Continue reading

Posted in Distributed systems | Leave a comment

Kafka Go client: No Producer error during connection ?

Although its rare, but there are times when you actually want to see errors in your code – more importantly, at the right time ! Kafka Go Producer behaviour You need to be mindful of this while using the Kafka … Continue reading

Posted in Distributed systems, go, Kafka, messaging | Tagged , , | Leave a comment

Kafka Go client quick start

Here is a Docker based example for Kafka using Go client Overview Simple producer and consumer apps Confluent Go client for Kafka its based on librdkafka (Kafka C client) client setup part is taken care of with a pre-built Docker image – … Continue reading

Posted in Distributed systems, Kafka, messaging | Leave a comment

Redis 5 – bootstrapping a Redis Cluster with Docker

With Redis 5 (in RC state at time of writing), cluster creation utility is now available as part of redis-cli which is easier as compared to the (previous) ruby way of doing it (using redis-trib) check out the release notes for … Continue reading

Posted in Distributed systems, nosql, redis | Tagged , , , , | 6 Comments

(eBook) Practical Redis: first few chapters released!

I am happy to announce that the first few chapters of Practical Redis are now available About Practical Redis   It is a hands-on, code-driven guide to Redis where each chapter is based on an application (simple to medium complexity) which … Continue reading

Posted in Distributed systems, go, nosql, redis | Tagged , , , , , , , , | Leave a comment

etcd Watch example using Go client

etcd is a distributed, highly available key-value store which serves as the persistent back end for Kubernetes Here is an example to demonstrate its Watch feature. For details, check out the README (and the sample code) on Github It uses etcd Docker … Continue reading

Posted in Distributed systems | Tagged , , , | Leave a comment

NATS on Kubernetes example

In a previous blog, you saw an example of NATS along with producer and consumer – based on Docker Compose. This post uses the same app, but runs on Kubernetes For how to run, follow the README on Github High … Continue reading

Posted in Distributed systems, Kubernetes, nats | Tagged , , , , , , , , | Leave a comment

NATS & Kafka: random notes

This is not NATS vs Kafka by any means – just jotting down some info. NATS recently joined CNCF (which host projects like Kubernetes, Prometheus etc. – look at the dominance of Golang here!) and that’s when it caught my attention … Continue reading

Posted in Distributed systems, Kafka, messaging | Tagged , , , | Leave a comment

NATS – quick start with Docker

Here is a hello-world example (on Github) for getting started with natsio – a distributed messaging server written in Go It consists of the following components which are managed via Docker Compose NATS server (of course) a Java producer/publisher a Go consumer/subscriber … Continue reading

Posted in Distributed systems, messaging | Tagged , , , , | 1 Comment