Making Apache Spark the Fastest Open Source Streaming Engine - The Databricks Blog

Structured Streaming is not only the the simplest streaming engine, but for many workloads it is the fastest. By leveraging all of the work done on the Catalyst query optimizer and the Tungsten execution engine, Structured Streaming brings the power of Spark SQL to real-time streaming. Our benchmar…