Tag Archives: apache kafka

Kafka Streams state stores…

Posted on March 21, 2017 by

This blog explores some common aspects of state stores in Kafka Streams… Default state store By default, Kafka Streams uses the RocksDB as it’s default state store In-memory or persistent ? This parameter of the state store is configurable. RocksDB can … Continue reading →

Posted in Distributed systems, Kafka | Tagged , , , , | 1 Comment

Docker-ized Kafka Streams applications

Posted on March 12, 2017 by

Here is another example of a Kafka Streams based application.. this time, it’s about running it in Docker containers – spawn more containers to distribute the processing load. More details in the README Cheers!

Posted in Distributed systems, Kafka | Tagged , , , , | Leave a comment

Microservices messaging on Oracle Cloud using Apache Kafka

Posted on January 9, 2017 by

Here is a blog I posted on the Oracle Cloud Developer Solutions portal. This is the first of a two-part series which shows asynchronous messaging b/w microservices with the help of a simple example (application) Technical components Oracle Cloud Oracle Compute … Continue reading →

Posted in Distributed systems, Kafka | Tagged , , , , , , , | Leave a comment

Kafka Partitioning…

Posted on December 13, 2016 by

Partitions are the key to scalability attributes of Kafka. Developers can also implement custom partitioning algorithm to override the default partition assignment behavior. This post will briefly cover Partitions in general Data distribution, default partitioning, and Example of custom partitioning … Continue reading →

Posted in Distributed systems, Kafka | Tagged , , , , | 2 Comments

Scaling out with Kafka Consumer Groups

Posted on November 29, 2016 by

This blog post will cover Apache Kafka consumers and demonstrate how they are designed for distributed, scale-out architectures. It assumes you have some idea about Kafka in general. We will mainly look at Kafka Consumers groups, and dive into the … Continue reading →

Posted in Distributed systems, Kafka | Tagged , , , , , , | 1 Comment