WEBINAR REPLAY 

Putting Kafka In Jail - Best Practices To Run Kafka On Kubernetes & DC/OS

With Sean Glover, Fast Data Engineer at Lightbend, Inc.

Audience: Architects, Developers

Technical level: Intermediate

Apache Kafka–part of Lightbend Fast Data Platform–is a distributed streaming platform that is best suited to run close to the metal on dedicated machines in statically defined clusters. For most enterprises, however, these fixed clusters are quickly becoming extinct in favor of mixed-use clusters that take advantage of all infrastructure resources available.

In this webinar by Sean Glover, Fast Data Engineer at Lightbend, we will review leading Kafka implementations on DC/OS and Kubernetes to see how they reliably run Kafka in container orchestrated clusters and reduce the overhead for a number of common operational tasks with standard cluster resource manager features. You will learn specifically about concerns like:

  • The need for greater operational knowhow to do common tasks with Kafka in static clusters, such as applying broker configuration updates, upgrading to a new version, and adding or decommissioning brokers.
  • The best way to provide resources to stateful technologies while in a mixed-use cluster, noting the importance of disk space as one of Kafka’s most important resource requirements.
  • How to address the particular needs of stateful services in a model that natively favors stateless, transient services.


WEBINAR REPLAY 

Putting Kafka In Jail - Best Practices To Run Kafka On Kubernetes & DC/OS

With Sean Glover, Fast Data Engineer at Lightbend, Inc. and

Audience: Architects, Developers

Technical level: Intermediate

Apache Kafka–part of Lightbend Fast Data Platform–is a distributed streaming platform that is best suited to run close to the metal on dedicated machines in statically defined clusters. For most enterprises, however, these fixed clusters are quickly becoming extinct in favor of mixed-use clusters that take advantage of all infrastructure resources available.

In this webinar by Sean Glover, Fast Data Engineer at Lightbend, we will review leading Kafka implementations on DC/OS and Kubernetes to see how they reliably run Kafka in container orchestrated clusters and reduce the overhead for a number of common operational tasks with standard cluster resource manager features. You will learn specifically about concerns like:

  • The need for greater operational knowhow to do common tasks with Kafka in static clusters, such as applying broker configuration updates, upgrading to a new version, and adding or decommissioning brokers.
  • The best way to provide resources to stateful technologies while in a mixed-use cluster, noting the importance of disk space as one of Kafka’s most important resource requirements.
  • How to address the particular needs of stateful services in a model that natively favors stateless, transient services.




SUBSCRIBE

SHARE

ABOUT PRESENTER

Sean Glover, Fast Data Engineer at Lightbend, Inc.

Sean has over 10 years of professional software development experience and is currently specializing in Scala, Spark, Kafka, Cassandra, and Akka. He has a passion for Scala and is an organizer of the Scala Toronto and Toronto Apache Spark meetups. He has a lifelong love of technology and keeps up-to-date by speaking at events, organizing local tech meetups, blogging, self-study and personal software projects.

ABOUT PRESENTERS

Sean Glover, Fast Data Engineer at Lightbend, Inc.

Sean has over 10 years of professional software development experience and is currently specializing in Scala, Spark, Kafka, Cassandra, and Akka. He has a passion for Scala and is an organizer of the Scala Toronto and Toronto Apache Spark meetups. He has a lifelong love of technology and keeps up-to-date by speaking at events, organizing local tech meetups, blogging, self-study and personal software projects.





About Lightbend

Lightbend (Twitter: @Lightbend) provides the leading Reactive application development platform for building distributed systems. Based on a message-driven runtime, these distributed systems, which include microservices and streaming fast data applications, can effortlessly scale on multi-core and cloud architectures. Many of the most admired brands around the globe are transforming their businesses with our platform, engaging billions of users every day through software that is changing the world. For more information on Lightbend, visit: lightbend.com