Spark: How to save a dataframe with headers?

With Spark 2.x,

df.write.option("header", "true").csv("path")

Cheers

If you want to save as csv file, i would suggest using spark-csv package. You can save your dataframe simply with spark-csv as below with header.

dataFrame.write
  .format("com.databricks.spark.csv")
  .option("header", "true")
  .option("delimiter",<your delimiter>)
  .save(output)

You can refer below link, for further information: https://github.com/databricks/spark-csv

Spark-csv has maven dependency.

Related