hadoop : datanode not running?
Okay,i find the workaround. It seems like i was having the error : Incompatible namespaceIDs. I found a work around here . So well it finally got solved.
If you are also having the same problem for Incompatible namespaceIDs, try the following, it worked like a charm for me. Leave comments if you still have problems and I will get back to you.
Solution :
1. Stop the problematic DataNode(s).
2. Edit the value of namespaceID in ${dfs.data.dir}/current/VERSION to match the corresponding value of the current NameNode in ${dfs.name.dir}/current/VERSION.
3. Restart the fixed DataNode(s). That will solve the problem for you.
- DataNode attempts to start but then shuts down.
It can be checked by
hadoop datanode -start
. The problem is due to Incompatible namespaceID.So, remove tmp directory using commands
sudo rm -Rf /app/hadoop/tmp
Then follow the steps from:
sudo mkdir -p /app/hadoop/tmp
http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/