Hadoop Professionals

A Community for Hadoop Users

ankit
  • Blog Posts
  • Discussions (2)
  • Events
  • Groups
  • Photos
  • Photo Albums

ankit's Discussions

hadoop write file in map function and read in reduce function (0.18.3 version)

As from the title it would be clear, I would like to write a file in map function and read in reduce function.My output was overwritten -in every execution of map.So I went ahead and give the file…Continue

Started Mar 23, 2010

 

ankit's Page

Gifts Received

Gift

ankit has not received any gifts yet

Give ankit a Gift

Latest Activity

Profile Icon

hadoop write file in map function and read in reduce function (0.18.3 version)

As from the title it would be clear, I would like to write a file in map function and read in reduce function.My output was overwritten -in every execution of map.So I went ahead and give the file name with task id.I wanted to the read the file in Reduce class ie. either in configure () or reduce()AnkitSee More
Discussion posted by ankit Mar 23, 2010
Profile Icon
ankit replied to Adeel's discussion 'do all mappers finish before reducer starts'
I am writing a temporary file from map function and would like to read in configure function of Reduce Class after all the maps are finished. My Question is "How do I make the configure to run after all maps"
Mar 23, 2010
Profile Icon
ankit is now a member of Hadoop Professionals Mar 23, 2010

Comment Wall

You need to be a member of Hadoop Professionals to add comments!

Join Hadoop Professionals

  • No comments yet!
 
 
 



Groups

© 2012   Created by Jason Venner.

Badges  |  Report an Issue  |  Terms of Service