Cloudflow: Accelerate Your Real-Time Streaming Journey

Audience: All Levels

Technical level: Introductory

Cloudflow is a unique, powerful system for building scalable, streaming-data pipelines composed of multi-component streamlets written in one or more streaming engines.

Most streaming data solutions comprise multiple components, implemented in different technologies, which you have to integrate yourself. What you use for streaming ETL is different than what you use for aggregations or model serving. Yet these various components must act as a single service to the external services.

Cloudflow supports streamlets written in Akka Streams and Spark Structured Streaming, transparently integrated together.

  • Developer productivity is accelerated by eliminating much of the boilerplate required when writing such applications, especially when composing domain-logic streamlets into complete applications.
  • The Cloudflow runtime environment automates many tasks, such as deployment, routing data between streamlets, and ensuring data safety.
  • A powerful, intuitive GUI visualizes the running pipelines with easy access to important health and performance metrics.
  • Management is simplified by automatic handling of many failure scenarios and restarts.

This brief provides context for Cloudflow helps you understand how it works with microservices to accelerate your journey toward the real-time enterprise.

Grab your copy

Please enter your information to receive your E-book chapter(s) of Cloudflow: Accelerate Your Real-Time Streaming Journey and be signed up for the Lightbend Newsletter. Once you've entered your information and submitted the form, the PDF will be emailed to your address.

*Required: The information you provide will be used in accordance with the terms of our privacy policy. To opt-out of receiving educational resources, manage your preferences here.


About Lightbend

Lightbend (@Lightbend) is leading the enterprise transformation toward real-time, cloud-native applications. Lightbend provides scalable, high-performance microservices frameworks and streaming engines for building data-centric systems that are optimized to run on cloud-native infrastructure like Kubernetes. The most admired brands around the globe are transforming their businesses with Lightbend, engaging billions of users every day through software that is changing the world. For more information, visit www.lightbend.com