New posts in Spark Streaming

set spark.streaming.kafka.maxRatePerPartition for createDirectStream

How to convert JavaPairInputDStream into DataSet/DataFrame in Spark

How to fix "java.io.NotSerializableException: org.apache.kafka.clients.consumer.ConsumerRecord" in Spark Streaming Kafka Consumer?

Spark Streaming Processing Time vs Total Delay vs Processing Delay

Spark DataFrame: does groupBy after orderBy maintain that order?

How to know what is the reason for ClosedChannelExceptions with spark-shell in YARN client mode?

reading json file in pyspark

build.sbt: how to add spark dependencies

Reading data from Azure Blob with Spark

Adding custom jars to pyspark in jupyter notebook