WEBINAR REPLAY 

Moving from Big Data to Fast Data? Here's How To Pick The Right Streaming Engine

With Dean Wampler, Ph.D., VP of Fast Data Engineering at Lightbend, Inc.

For many businesses, the batch-oriented architecture of Big Data–where data is captured in large, scalable stores, then processed later–is simply too slow: a new breed of “Fast Data” architectures has evolved to be stream-oriented, where data is processed as it arrives, providing businesses with a competitive advantage.

There are many stream processing tools, so which ones should you choose? It helps to consider several factors in the context of your applications:

  • Low latency: How low is necessary?
  • High volume: How high is required?
  • Integration with other tools: Which ones and how?
  • Data processing: What kinds? In bulk? As individual events?

In this talk by Dean Wampler, PhD., VP of Fast Data Engineering at Lightbend, we’ll look at the criteria you need to consider when selecting technologies, plus specific examples of how four streaming tools–Akka Streams, Kafka Streams, Apache Flink and Apache Spark serve particular needs and use cases when working with continuous streams of data.



WEBINAR REPLAY 

Moving from Big Data to Fast Data? Here's How To Pick The Right Streaming Engine

With Dean Wampler, Ph.D., VP of Fast Data Engineering at Lightbend, Inc. and Hugh McKee, Global Solutions Architect at Lightbend, Inc.

For many businesses, the batch-oriented architecture of Big Data–where data is captured in large, scalable stores, then processed later–is simply too slow: a new breed of “Fast Data” architectures has evolved to be stream-oriented, where data is processed as it arrives, providing businesses with a competitive advantage.

There are many stream processing tools, so which ones should you choose? It helps to consider several factors in the context of your applications:

  • Low latency: How low is necessary?
  • High volume: How high is required?
  • Integration with other tools: Which ones and how?
  • Data processing: What kinds? In bulk? As individual events?

In this talk by Dean Wampler, PhD., VP of Fast Data Engineering at Lightbend, we’ll look at the criteria you need to consider when selecting technologies, plus specific examples of how four streaming tools–Akka Streams, Kafka Streams, Apache Flink and Apache Spark serve particular needs and use cases when working with continuous streams of data.



SUBSCRIBE

SHARE

About Presenter

Dean Wampler, Ph.D., VP of Fast Data Engineering at Lightbend, Inc.

Dean Wampler is the Vice President of Fast Data Engineering at Lightbend, where he leads the creation of the Lightbend Fast Data Platform, a streaming data platform built on the Lightbend Reactive Platform, Kafka, Spark, Flink, and Mesosphere DC/OS. Dean is the author of Programming Scala and Functional Programming for Java Developers and the coauthor of Programming Hive, all from O’Reilly. He is a contributor to several open source projects and he is the co-organizer of several conferences around the world and several user groups in Chicago.

About Presenters

Dean Wampler, Ph.D., VP of Fast Data Engineering at Lightbend, Inc.

Dean Wampler is the Vice President of Fast Data Engineering at Lightbend, where he leads the creation of the Lightbend Fast Data Platform, a streaming data platform built on the Lightbend Reactive Platform, Kafka, Spark, Flink, and Mesosphere DC/OS. Dean is the author of Programming Scala and Functional Programming for Java Developers and the coauthor of Programming Hive, all from O’Reilly. He is a contributor to several open source projects and he is the co-organizer of several conferences around the world and several user groups in Chicago.

Hugh McKee, Global Solutions Architect at Lightbend, Inc.

Hugh is a solutions architect at Lightbend. He’s had a long career building applications that evolved slowly, that inefficiently utilized their infrastructure, and that were brittle and prone to failure. That all changed when he started building reactive, asynchronous, actor-based systems. This radically new way of building applications rocked his world. As an added benefit, building application systems became way more fun that it had ever been. Now he is focused on helping others to discover the significant advantages and joys of building responsive, resilient, elastic, message-based applications.

About Lightbend

Lightbend (Twitter: @Lightbend) provides the leading Reactive application development platform for building distributed systems. Based on a message-driven runtime, these distributed systems, which include microservices and streaming fast data applications, can effortlessly scale on multi-core and cloud architectures. Many of the most admired brands around the globe are transforming their businesses with our platform, engaging billions of users every day through software that is changing the world. For more information on Lightbend, visit: lightbend.com