Hadoop Professionals

A Community for Hadoop Users

Marc Sturlese
  • Blog Posts (1)
  • Discussions
  • Events
  • Groups
  • Photos
  • Photo Albums

Marc Sturlese's Friends

  • Daniel Gimenez
 

Marc Sturlese's Page

Gifts Received

Gift

Marc Sturlese has not received any gifts yet

Give Marc Sturlese a Gift

Latest Activity

Profile Icon
Anantha Srivathsa N commented on Marc Sturlese's blog post 'datanode can not connect to the namenode in a small hadoop cluster'
Marc, Can you check the files, in conf directory, named "masters" and "slaves". In this directory we need to explicitly state namenode ip address in "masters" and datanode ip address (one ip address per line) in…
Aug 6, 2010
Profile Icon
Marc Sturlese commented on Marc Sturlese's blog post 'datanode can not connect to the namenode in a small hadoop cluster'
Solved. The problem was the /etc/hosts. As far as I understand now all nodes must have the ip and hostname of all members of the cluster (and themselves, of course). So, my /etc/hosts for both nodes now looks like (I am running under ubuntu…
Feb 15, 2010
Profile Icon
Marc Sturlese commented on Marc Sturlese's blog post 'datanode can not connect to the namenode in a small hadoop cluster'
Yes, looking at the logs seems they are. Actually if I stop the daemonds with ./stop-hdfs.sh and ./stop.mapred.sh I can see the messages that namenode, jobtracker and the 2 datanodes and tasktrackers are being shut down. When they are up I can use…
Feb 15, 2010
Profile Icon
Jason Venner commented on Marc Sturlese's blog post 'datanode can not connect to the namenode in a small hadoop cluster'
Can you verify that the Namenode, and Datanode server processes are running.
Feb 15, 2010
Profile Icon
Blog posts by Marc Sturlese Feb 15, 2010
Profile IconProfile Icon
Marc Sturlese and Daniel Gimenez are now friends Jan 25, 2010
Profile Icon
Marc Sturlese updated their profile photo Jan 23, 2010
Profile Icon
Marc Sturlese is now a member of Hadoop Professionals Jan 23, 2010

Profile Information

Hadoop Experience Level
Beginner
Interests
Search and scalability (Lucene, Solr, Hadoop, Katta)
Available for Consulting
Yes
Your Website
http://www.marcsturlese.com
Search Expertise
Expert

Marc Sturlese's Blog

Marc Sturlese

datanode can not connect to the namenode in a small hadoop cluster

Hey there I have a hadoop cluster build on 2 servers (2 laptops). One node (A)

contains the namenode, a datanode, the jobtraker and a tasktraker.



The other node(B) just has a datanode and a tasktraker.

I set up correctly hdfs with ./start-hdfs.sh



When I try to set up MapReduce with ./start-mapred.sh the TaskTraker of node (B) can not connect to the namenode. The tasktracker log will

keep throwing:





INFO org.apache.hadoop.ipc.Client: Retrying… Continue

Posted on February 15, 2010 at 7:00am — 4 Comments

Comment Wall

You need to be a member of Hadoop Professionals to add comments!

Join Hadoop Professionals

  • No comments yet!
 
 
 



Groups

© 2012   Created by Jason Venner.

Badges  |  Report an Issue  |  Terms of Service