WEBINAR REPLAY | Reactive, fast-data, akka

Lessons Learned From PayPal: Implementing Back-Pressure With Akka Streams And Kafka

With Akara Sucharitakul, Principal MTS, Global Platform Frameworks, PayPal, Inc.

Akka Streams and its amazing handling of streaming with back-pressure should be no surprise to anyone. But it takes a couple of use cases to really see it in action - especially in use cases where the amount of work continues to increase as you’re processing it. This is where back-pressure really shines.

In this talk for Architects and Dev Managers by Akara Sucharitakul, Principal MTS for Global Platform Frameworks at PayPal, Inc., we look at how back-pressure based on Akka Streams and Kafka is being used at PayPal to handle very bursty workloads.

In addition, Akara will also share experiences in creating a platform based on Akka and Akka Streams that currently processes over 1 billion transactions per day (on just 8 VMs), with the aim of helping teams adopt these technologies. In this webinar, you will:

  • Start with a sample web crawler use case to examine what happens when each processing pass expands to a larger and larger workload to process.
  • Review how we use the buffering capabilities in Kafka and the back-pressure with asynchronous processing in Akka Streams to handle such bursts.
  • Look at lessons learned, plus some constructive “rants” about the architectural components, the maturity, or immaturity you’ll expect, and tidbits and open source goodies like memory-mapped stream buffers that can be helpful in other Akka Streams and/or Kafka use cases.


WEBINAR REPLAY | Reactive, fast-data, akka

Lessons Learned From PayPal: Implementing Back-Pressure With Akka Streams And Kafka

With Akara Sucharitakul, Principal MTS, Global Platform Frameworks, PayPal, Inc. and Justin Pihony, Developer Support Engineer at Lightbend, Inc.

Akka Streams and its amazing handling of streaming with back-pressure should be no surprise to anyone. But it takes a couple of use cases to really see it in action - especially in use cases where the amount of work continues to increase as you’re processing it. This is where back-pressure really shines.

In this talk for Architects and Dev Managers by Akara Sucharitakul, Principal MTS for Global Platform Frameworks at PayPal, Inc., we look at how back-pressure based on Akka Streams and Kafka is being used at PayPal to handle very bursty workloads.

In addition, Akara will also share experiences in creating a platform based on Akka and Akka Streams that currently processes over 1 billion transactions per day (on just 8 VMs), with the aim of helping teams adopt these technologies. In this webinar, you will:

  • Start with a sample web crawler use case to examine what happens when each processing pass expands to a larger and larger workload to process.
  • Review how we use the buffering capabilities in Kafka and the back-pressure with asynchronous processing in Akka Streams to handle such bursts.
  • Look at lessons learned, plus some constructive “rants” about the architectural components, the maturity, or immaturity you’ll expect, and tidbits and open source goodies like memory-mapped stream buffers that can be helpful in other Akka Streams and/or Kafka use cases.


About Presenter

Akara Sucharitakul, Principal MTS, Global Platform Frameworks, PayPal, Inc.

Akara Sucharitakul founded Project squbs (pronounced s-cubes) for Internet scale Akka productionalization. He works in the PayPal infrastructure team and is a 20-year veteran of the JVM from its very early days, including being with Sun for 15 years. He left his fingerprints all over industry-wide standards for testing and measuring server-side Java performance.

Akara has a lifetime passion on performance, scalability, and resiliency, and appreciates the beauty of application architecture and simplicity.

About Presenters

Akara Sucharitakul, Principal MTS, Global Platform Frameworks, PayPal, Inc.

Akara Sucharitakul founded Project squbs (pronounced s-cubes) for Internet scale Akka productionalization. He works in the PayPal infrastructure team and is a 20-year veteran of the JVM from its very early days, including being with Sun for 15 years. He left his fingerprints all over industry-wide standards for testing and measuring server-side Java performance.

Akara has a lifetime passion on performance, scalability, and resiliency, and appreciates the beauty of application architecture and simplicity.

Justin Pihony, Developer Support Engineer at Lightbend, Inc.

Justin is the frontline defense providing support for all technical questions related to our products. Justin likes  to refer to it as StackOverflow++.  Until Lightbend Justin’s  professional career has been Microsoft based (SQL and C#). However, he has used Scala in teaching (Pluralsight) and side projects for the past 4+ years. Justin has been especially deep into Spark for the past 1-2 years.

About Lightbend

Lightbend (Twitter: @Lightbend) is dedicated to helping developers build Reactive applications on the JVM. With the Lightbend Reactive Platform, developers can create message-driven applications that scale on multicore and cloud computing architectures by using projects like Lagom, Play Framework, Akka, Scala, Java, and Apache Spark. To help our customers succeed, Lightbend partners with technology pioneers such as Databricks, IBM, and Mesosphere.