WEBINAR REPLAY 

Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications

With Sean Glover, Principal Engineer at Lightbend, Inc.

Audience: Architects, Developers

Technical level: Intermediate

Apache Kafka, the popular messaging backplane, is traditionally well suited to run on statically defined clusters, but running it on container orchestrated clusters like Kubernetes is becoming more common. The best way to run stateful services on Kubernetes that have complex operational needs (such as Kafka) is to use the Operator pattern. Meet Strimzi, the leading open source project to run Apache Kafka and ZooKeeper on Kubernetes.

In this talk by Sean Glover, Principal Engineer at Lightbend, we will review how the Strimzi Kafka Operator, a supported technology in Lightbend Platform, makes many operational tasks in Kafka easy, such as the initial deployment and updates of a Kafka and ZooKeeper cluster. We’ll look at:

  • Why using the Operator pattern is the best way to run stateful services with complex operational needs like Kafka.
  • How to manage Kafka resources such as brokers, ZooKeeper, topics, users, and mirror-maker configurations using Kubernetes Custom Resources.
  • How to use transient and persistent volume storage options, and make common operational tasks easier, such as rolling cluster updates and upgrades, scaling brokers, moving brokers, monitoring, and running multiple Kafka clusters on the same Kubernetes cluster.


WEBINAR REPLAY 

Running Kafka On Kubernetes With Strimzi For Real-Time Streaming Applications

With Sean Glover, Principal Engineer at Lightbend, Inc. and

Audience: Architects, Developers

Technical level: Intermediate

Apache Kafka, the popular messaging backplane, is traditionally well suited to run on statically defined clusters, but running it on container orchestrated clusters like Kubernetes is becoming more common. The best way to run stateful services on Kubernetes that have complex operational needs (such as Kafka) is to use the Operator pattern. Meet Strimzi, the leading open source project to run Apache Kafka and ZooKeeper on Kubernetes.

In this talk by Sean Glover, Principal Engineer at Lightbend, we will review how the Strimzi Kafka Operator, a supported technology in Lightbend Platform, makes many operational tasks in Kafka easy, such as the initial deployment and updates of a Kafka and ZooKeeper cluster. We’ll look at:

  • Why using the Operator pattern is the best way to run stateful services with complex operational needs like Kafka.
  • How to manage Kafka resources such as brokers, ZooKeeper, topics, users, and mirror-maker configurations using Kubernetes Custom Resources.
  • How to use transient and persistent volume storage options, and make common operational tasks easier, such as rolling cluster updates and upgrades, scaling brokers, moving brokers, monitoring, and running multiple Kafka clusters on the same Kubernetes cluster.




SUBSCRIBE

SHARE

ABOUT PRESENTER

Sean Glover, Principal Engineer at Lightbend, Inc.

Sean has over 10 years of professional software development experience and is currently specializing in Scala, Spark, Kafka, Cassandra, and Akka. He has a passion for Scala and is an organizer of the Scala Toronto and Toronto Apache Spark meetups. He has a lifelong love of technology and keeps up-to-date by speaking at events, organizing local tech meetups, blogging, self-study and personal software projects.

ABOUT PRESENTERS

Sean Glover, Principal Engineer at Lightbend, Inc.

Sean has over 10 years of professional software development experience and is currently specializing in Scala, Spark, Kafka, Cassandra, and Akka. He has a passion for Scala and is an organizer of the Scala Toronto and Toronto Apache Spark meetups. He has a lifelong love of technology and keeps up-to-date by speaking at events, organizing local tech meetups, blogging, self-study and personal software projects.





About Lightbend

Lightbend (@Lightbend) is leading the enterprise transformation toward real-time, cloud-native applications. Lightbend Platform provides scalable, high-performance microservices frameworks and streaming engines for building data-centric systems that are optimized to run on cloud-native infrastructure. The most admired brands around the globe are transforming their businesses with Lightbend, engaging billions of users every day through software that is changing the world. For more information, visit lightbend.com.