Cloudflow is a unique, powerful system for building scalable, streaming-data pipelines composed of multi-component streamlets written in one or more streaming engines.

Most streaming data solutions comprise multiple components, implemented in different technologies, which you have to integrate yourself. What you use for streaming ETL is different than what you use for aggregations or model serving. Yet these various components must act as a single service to the external services.

Cloudflow supports streamlets written in Akka Streams and Spark Structured Streaming, transparently integrated together.

• Developer productivity is accelerated by eliminating much of the boilerplate required when writing such applications, especially when composing domain-logic streamlets into complete applications.
• The Cloudflow runtime environment automates many tasks, such as deployment, routing data between streamlets, and ensuring data safety.
• A powerful, intuitive GUI visualizes the running pipelines with easy access to important health and performance metrics.
• Management is simplified by automatic handling of many failure scenarios and restarts.

This brief provides context for Cloudflow helps you understand how it works with microservices to accelerate your journey toward the real-time enterprise.