How do I pass program-argument to main function in running spark-submit with a JAR?
Arguments passed before the .jar file will be arguments to the JVM, where as arguments passed after the jar file will be passed on to the user's program.
bin/spark-submit --class classname -Xms256m -Xmx1g something.jar someargument
Here, s
will equal someargument
, whereas the -Xms -Xmx
is passed into the JVM.
public static void main(String[] args) {
String s = args[0];
}
I found the correct command from this tutorial.
The command should be of the form:
bin/spark-submit --class full.package.name.ClassName analytics-package.jar someargument someArgument