New posts in Apache Spark

How to fix 'TypeError: an integer is required (got type bytes)' error when trying to run pyspark after installing spark 2.4.4

How to speed up spark df.write jdbc to postgres database?

Existing data for tests is not found Scala Specs2

Delta Lake rollback

Spark: How to aggregate/reduce records based on time difference?

Since Spark 2.3, the queries from raw JSON/CSV files are disallowed when the referenced columns only include the internal corrupt record column

Clone/Deep-Copy a Spark DataFrame

reading data from URL using spark databricks platform

Spark union column order

How can I convince spark not to make an exchange when the join key is a super-set of the bucketBy key?