For many enterprises, the "big" in Big Data is less about the overall volume of data and much more about the need for speed in shuffling data around in real time. We use the term “Fast Data” to describe the trend that enabled this fundamental shift from "data at rest" to "data in motion” to happen. Our data used to be offline––now it's online. Today we can see three major trends driving data volumes, velocity and variety at unprecedented exploding levels that threaten traditional datacenters with a literal data deluge:
By 2020, Gartner estimates that over 20 billion connected devices will be online, and that getting business value from this new big data opportunity will be a $263 billion market.
One of the main drivers of this movement is Reactive Streams 1.0.0 for the JVM, an effort to define a standard for passing streams of data between threads in an asynchronous and non-blocking fashion. This is a common need in Reactive systems, in which the volume of streaming "live" data to process is not predetermined.
Engineers from Lightbend are among the founding members of the Reactive Streams initiative, with Akka Streams (which includes Akka HTTP) at the forefront of this paradigm shift to “data in motion”.
In this whitepaper by Lightbend, we introduce Architects to the concepts behind the Reactive Streams initiative and expose the inner workings and benefits of Akka Streams and Akka HTTP.
p.s. If you want to talk to someone at Lightbend about commercial products, subscriptions, training, or consulting, just let us know.
Lightbend (Twitter: @Lightbend) is dedicated to helping developers build Reactive applications on the JVM. With the Lightbend Reactive Platform, developers can create message-driven applications that scale on multicore and cloud computing architectures by using projects like Lagom, Play Framework, Akka, Scala, Java, and Apache Spark. To help our customers succeed, Lightbend partners with technology pioneers such as Databricks, IBM, and Mesosphere.