Hadoop Professionals

A Community for Hadoop Users

Aprile Matteo
Aprile Matteo
  • 26, Male
  • Salerno
  • Italy
Share on Facebook Share Twitter
  • Blog Posts
  • Discussions (3)
  • Events
  • Groups
  • Photos
  • Photo Albums

Aprile Matteo's Discussions

Launching a shell command in reduce method with Java
3 Replies

Hi guys,We're some students of University of Fisciano(SA-Italy).  We're wrinting a MapReduce program for a chemistry problem and we need to launch a shell command in our reduce method. This is the…Continue

Started this discussion. Last reply by Jason Venner Feb 21, 2010.

 

Aprile Matteo's Page

Gifts Received

Gift

Aprile Matteo has not received any gifts yet

Give Aprile Matteo a Gift

Latest Activity

Profile Icon
Jason Venner replied to Aprile Matteo's discussion 'Launching a shell command in reduce method with Java'
My inclination is to thing this is a PATH environment variable issue or an issue with the command string you are trying to execute. When I have to debug this class of problem, I pass a simple shell script via the distributed cache -file…
Feb 21, 2010
Profile Icon
Aprile Matteo replied to Aprile Matteo's discussion 'Launching a shell command in reduce method with Java'
thx a lot for your answer but I must execute an esternal script that call a molecolar program. This command is "./yasara ........" I alreay tried to use the FsShell class but it compare the same exception. I think that I could be a…
Feb 20, 2010
Profile Icon
Jason Venner replied to Aprile Matteo's discussion 'Launching a shell command in reduce method with Java'
I doubt that the hadoop script is in your path at task execution time. You can check the value of the PATH environment variable. You may also try giving an explicit path starting from /. In addition most of the commands you are trying to invoke via…
Feb 20, 2010
Profile Icon

Webinar- Large Data & Compute problems: Real solutions for your business at Your desktop!

February 26, 2010 from 10am to 12pm
Hear from the experts on how High Performance Computing can improve your business on a day-to-day basis.Attend this webinar to understand-- Whether you really need HPC- What data or compute intensive problems can HPC solve for you- How can contemporary HPC offer an optimal solution- How companies are realizing huge RoI benefits- How can you best leverage HPC best practices for your businessRegister at…See More
Aprile Matteo might attend Impetus Technologies's event Feb 18, 2010
Profile Icon
Aprile Matteo updated their profile Feb 18, 2010
Profile Icon
Aprile Matteo updated their profile photo Feb 18, 2010
Profile Icon

Launching a shell command in reduce method with Java

Hi guys,We're some students of University of Fisciano(SA-Italy).  We're wrinting a MapReduce program for a chemistry problem and we need to launch a shell command in our reduce method. This is the code:*Process p = Runtime.getRuntime().exec("hadoop fs -cp /source/* /dest");try{p.waitFor();}catch (Exception e) {e.getMessage();}Thi is another mode to call a shell command but we have the same negative result....Shell.execCommand("hadoop fs -cp /projects/* /" + name_dir);and when we launch the…See More
Discussion posted by Aprile Matteo Feb 18, 2010
Profile Icon
Aprile Matteo replied to ulhas's discussion 'Shuffle Error'
Hi, i've the same problem. When I lunch my program, i have this error: Status : FAILED Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out. I readed in your previous post that the problem was some inconsistencies in the hostname and…
Jan 11, 2010
Profile Icon
Aprile Matteo is now a member of Hadoop Professionals Jan 11, 2010

Profile Information

Hadoop Experience Level
Beginner

Comment Wall

You need to be a member of Hadoop Professionals to add comments!

Join Hadoop Professionals

  • No comments yet!
 
 
 



Groups

© 2012   Created by Jason Venner.

Badges  |  Report an Issue  |  Terms of Service