java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. spark Eclipse on windows 7
Here is a good explanation of your problem with the solution.
- Download winutils.exe from http://public-repo-1.hortonworks.com/hdp-win-alpha/winutils.exe.
SetUp your HADOOP_HOME environment variable on the OS level or programmatically:
System.setProperty("hadoop.home.dir", "full path to the folder with winutils");
Enjoy
- Download winutils.exe
- Create folder, say
C:\winutils\bin
- Copy
winutils.exe
insideC:\winutils\bin
- Set environment variable
HADOOP_HOME
toC:\winutils
Follow this:
Create a
bin
folder in any directory(to be used in step 3).Download winutils.exe and place it in the bin directory.
Now add
System.setProperty("hadoop.home.dir", "PATH/TO/THE/DIR");
in your code.