eBook Excerpt

Stream Processing with Apache Flink

Fabian Hueske, Software Engineer, data Artisans

Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

Audience: Architects, Managers

Technical level: Introductory

Note: this preview download contains chapters 2 and 3 of Stream Processing with Apache Flink

Get started with Apache Flink, the open source framework that enables you to process streaming data - such as user interactions, sensor data, and machine logs - as it arrives. With this practical guide, you’ll learn how to use Apache Flink's stream processing APIs to implement, continuously run, and maintain real-world applications.

Authors Fabian Hueske, one of Flink’s initial authors, and post-doctoral rearcher Vasia Kalavri explain the fundamental concepts of parallel stream processing and shows you how streaming analytics differs from traditional batch data analysis. Software engineers, data engineers, and system administrators will learn the basics of Flink’s DataStream API, including the structure and components of a common Flink streaming application.

  • Solve real-world problems with Apache Flink's DataStream API
  • Set up an environment for developing stream processing applications for Flink
  • Design streaming applications and migrate periodic batch workloads to continuous streaming workloads
  • Learn about windowed operations that process groups of records
  • Ingest data streams into a DataStream application and emit a result stream into different storage systems
  • Implement stateful and custom operators common in stream processing applications
  • Operate, maintain, and update continuously running Flink streaming applications
  • Explore several deployment options, including the setup of highly available installations

Grab your copy

Please enter your information to receive your E-book chapter(s) of Stream Processing with Apache Flink and be signed up for the Lightbend Newsletter. Once you've entered your information and submitted the form, the PDF will be emailed to your address.

*Required: The information you provide will be used in accordance with the terms of our privacy policy. To opt-out of receiving educational resources, manage your preferences here.


Fabian Hueske, Software Engineer, data Artisans

Fabian Hueske is a PMC member of Apache Flink. He started working on this project in 2009 as part of his PhD research at TU Berlin. Fabian is a co-founder of data Artisans, a Berlin-based start-up devoted to foster Apache Flink, and did internships with IBM Research, SAP Research, and Microsoft Research. He is frequently giving talks on Apache Flink at conferences and meetups. Fabian is interested in distributed data processing and query optimization.

Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

About Lightbend

Lightbend (@Lightbend) is leading the enterprise transformation toward real-time, cloud-native applications. Lightbend Platform provides scalable, high-performance microservices frameworks and streaming engines for building data-centric systems that are optimized to run on cloud-native infrastructure. The most admired brands around the globe are transforming their businesses with Lightbend, engaging billions of users every day through software that is changing the world. For more information, visit lightbend.com.