New posts in Distributed Computing

pyspark : NameError: name 'spark' is not defined

How to force Spark to evaluate DataFrame operations inline

Exploding nested Struct in Spark dataframe

Active tasks is a negative number in Spark UI

In-memory cache VS. centralized cache in a distributed system

Zookeeper vs In-memory-data-grid vs Redis

Is it possible to add partitions to an existing topic in Kafka 0.8.2

Google Dataflow vs Apache Spark

Would Spark unpersist the RDD itself when it realizes it won't be used anymore?

What are workers, executors, cores in Spark Standalone cluster?