Stream Processing with Apache Flink

eBook Excerpt

Stream Processing with Apache Flink

By Fabian Hueske, Software Engineer, data Artisans

By Fabian Hueske, Software Engineer, data Artisans and Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

Note: this preview download contains chapters 2 and 3 of Stream Processing with Apache Flink

Get started with Apache Flink, the open source framework that enables you to process streaming data - such as user interactions, sensor data, and machine logs - as it arrives. With this practical guide, you’ll learn how to use Apache Flink's stream processing APIs to implement, continuously run, and maintain real-world applications.

Authors Fabian Hueske, one of Flink’s initial authors, and post-doctoral rearcher Vasia Kalavri explain the fundamental concepts of parallel stream processing and shows you how streaming analytics differs from traditional batch data analysis. Software engineers, data engineers, and system administrators will learn the basics of Flink’s DataStream API, including the structure and components of a common Flink streaming application.

  • Solve real-world problems with Apache Flink's DataStream API
  • Set up an environment for developing stream processing applications for Flink
  • Design streaming applications and migrate periodic batch workloads to continuous streaming workloads
  • Learn about windowed operations that process groups of records
  • Ingest data streams into a DataStream application and emit a result stream into different storage systems
  • Implement stateful and custom operators common in stream processing applications
  • Operate, maintain, and update continuously running Flink streaming applications
  • Explore several deployment options, including the setup of highly available installations

Pssst: Do you know about the Reactive Summit? The premier event for microservices, Fast Data, and distributed systems will be back in Austin, Oct 19-20, 2017!

Grab your copy

Please enter your information to receive your E-book chapter(s) of Stream Processing with Apache Flink by Fabian Hueske, Software Engineer, data Artisans Fabian Hueske, Software Engineer, data Artisans and Vasia Kalavri, Postdoctoral Researcher, ETH Zurich and be signed up for the Lightbend Newsletter. Once you've entered your information and submitted the form, the PDF will be emailed to your address.

About Author

Fabian Hueske, Software Engineer, data Artisans

Fabian Hueske is a PMC member of Apache Flink. He started working on this project in 2009 as part of his PhD research at TU Berlin. Fabian is a co-founder of data Artisans, a Berlin-based start-up devoted to foster Apache Flink, and did internships with IBM Research, SAP Research, and Microsoft Research. He is frequently giving talks on Apache Flink at conferences and meetups. Fabian is interested in distributed data processing and query optimization.

About Authors

Fabian Hueske, Software Engineer, data Artisans

Fabian Hueske is a PMC member of Apache Flink. He started working on this project in 2009 as part of his PhD research at TU Berlin. Fabian is a co-founder of data Artisans, a Berlin-based start-up devoted to foster Apache Flink, and did internships with IBM Research, SAP Research, and Microsoft Research. He is frequently giving talks on Apache Flink at conferences and meetups. Fabian is interested in distributed data processing and query optimization.

Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

Vasia Kalavri, Postdoctoral Researcher, ETH Zurich

About Lightbend

Lightbend (Twitter: @Lightbend) is dedicated to helping developers build Reactive applications on the JVM. With the Lightbend Reactive Platform, developers can create message-driven applications that scale on multicore and cloud computing architectures by using projects like Lagom, Play Framework, Akka, Scala, Java, and Apache Spark. To help our customers succeed, Lightbend partners with technology pioneers such as Databricks, IBM, and Mesosphere.