How to check the Spark version
If you use Spark-Shell, it appears in the banner at the start.
Programatically, SparkContext.version can be used.
You can use spark-submit command:
spark-submit --version
Open Spark shell Terminal, run sc.version
If you use Spark-Shell, it appears in the banner at the start.
Programatically, SparkContext.version can be used.
You can use spark-submit command:
spark-submit --version
Open Spark shell Terminal, run sc.version