Getting Started with Spark Structured Streaming and Kafka on AWS using Amazon MSK and Amazon EMR
Exploring Apache Spark with Apache Kafka using both batch queries and Spark Structured Streaming
Published in
22 min readSep 9, 2021
Structured Streaming is a scalable and fault-tolerant stream processing engine built on the Spark SQL engine. Using Structured Streaming, you can express your streaming computation the same way you would express a batch computation on static data. In this post, we will learn how to use Apache Spark and Spark…