Sunday, 4 May 2014

Map-Only Jobs In Hadoop

There may be reasons where Map-Only job is needed,Where there is no Reducer to execute.Here Map does all its task with its InputSplit and no job for Reducer.This can be achieved by setting  job.setNumReduceTasks()  to Zero in Configuration.

Job job = new Job(getConf(), "Map-Only Job");


 * Set no of reducers to 0



FileInputFormat.addInputPath(job, new Path(args[0]));
FileOutputFormat.setOutputPath(job, new Path(args[1]));

boolean success = job.waitForCompletion(true);
return(success ? 0 : 1);

This sets Reducer task to 0 and turns off the Reducer.


So the no. of output files will be equal to no. of mappers and output files will be named as part-m-00000.

And once Reducer task is set to Zero the result will be unsorted.

If we are not specifying this property in Configuration, an Identity Reducer will get executed in which the same value is simply emitted along with the incoming key and the output file will be part-r-00000.

Happy Hadooping ...


  1. In what types of situations might it be ideal not to run any reducers?

    1. For image processing and all we dont need to run a reducer and even in some preprocessor techniques in dataMining while chaining different jobs there are situation where we dont need a key(Nullwritable key) but only values. In that situation if we dont want output in a single file we can run the job without reducers.

  2. Hi this is vignesh i am having 3 years of experience as a android developer and i am certified. i have knowledge on OOPS concepts in android but dont know indepth. After learning hadoop will be enough to get a good career in IT with good package? and i crossed hadoop training in chennai website where someone please help me to identity the syllabus covers everything or not??


    1. Hi Vignesh, I have gone through the training link.It covers almost everything.When did you appeared for the training.If you have confidence you can register for Cloudera certification exam.It is quite easy but tricky.And you will get a good career too. Pls have a look at this: " ". Let me know if you have further queries

  3. There are lots of information about latest technology and how to get trained in them, like Hadoop Training Chennai have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get trained in future technologies(Hadoop Training in Chennai). By the way you are running a great blog. Thanks for sharing this.

  4. The expansion of internet and other business intelligence leads to large volume of data. Industries are looking for talented professionals to maintain and process huge volume of data with latest tools available in the market. Taking Hadoop Training in Chennai | Big Data Training in Chennai will ensure better career prospects for talented professionals.

  5. Thank you so much.your blog is very helpful.Could you please post any material on Web services testing too.

    Hadoop Certification in Chennai

  6. Thank you so much.your blog is very helpful.Could you please post any material on Web services testing too.
    qlikview training in chennai

  7. I was getting errors trying to run this program with my own input, so I changed "wiki/in" in the driver file to args[0], and it ran successfully.
    But my output seems to match with the sample output of job 1 for each iteration, instead of converting to the formats of job 2 and 3. Could this small change in code have changed so much? How?

    hadoop training in chennai

  8. This is extremely helpful info!! Very good work. It is very interesting to learn and easy to understood. Thank you for giving information. Please let us know and more information get a post to link. Data Science Training | Online Data Science Training

  9. Excellent and very cool idea and the subject at the top of magnificence and I am happy to this post..Interesting post! Thanks for writing it.What's wrong with this kind of post exactly? It follows your previous guideline for post length as well as clarity..
    Android Training in Chennai

  10. This is excellent information. It is amazing and wonderful to visit your site.Thanks for sharing this information&its very useful to me...
    Android training in chennai
    Ios training in chennai

  11. Very nice post here and thanks for it .I always like and such a super contents of these post.Excellent and very cool idea and great content of different kinds of the valuable information's.
    Hadoop Training in Chennai

  12. Great and interesting article to read.. i Gathered more useful and new information from this article.thanks a lot for sharing this article to us..

    best institute for big data in Chennai | big data training in Velachery

  13. Useful article.. This article helpful to me for update my hadoop skills ..

    hadoop training in chennai | big data training in chennai

  14. Thank you for taking the time and sharing this information with us. It was indeed very helpful and insightful while being straight forward and to the point. | |

  15. Really useful information about hadoop, i have to know information about hadoop online training institutes.

  16. Really Superb Information About hadoop here is the best for Hadoop Training

  17. Excellent post ..really useful blog... thanks for sharing...

    Hadoop Common Training

  18. And indeed, I’m just always astounded concerning the remarkable things served by you. Some four facts on this page are undeniably the most effective I’ve had.
    Hadoop Training Institute In chennai


  19. I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.
    Best Python training Institute in chennai

  20. Great article. Thanks for providing such a wonderful and very useful blog over here.I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.
    selenium training in chennai

  21. I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site.
    Best selenium training Institute in chennai

  22. Amazon Web Services (AWS) certification training helps you to gain real time hands on experience on AWS. myTectra offersAWS training in Bangaloreusing classroom and AWS Online Training globally.

  23. Great post! I am actually getting ready to across this information, It’s very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well.
    Data Science Training in Chennai
    Data science training in bangalore
    Data science online training
    Data science training in pune
    Data science training in kalyan nagar
    Data science training in Bangalore
    Data science training in tambaram

  24. Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us and I never get bored while reading your article because, they are becomes a more and more interesting from the starting lines until the end.
    Devops training in velachry
    Devops training in OMR
    Deops training in annanagar
    Devops training in chennai
    Devops training in marathahalli
    Devops training in rajajinagar
    Devops training in BTM Layout

  25. I wish to show thanks to you just for bailing me out of this particular trouble.As a result of checking through the net and meeting techniques that were not productive, I thought my life was done.

    ccna training in chennai

    ccna training in bangalore

    ccna training in pune

  26. Thank you so much for a well written, easy to understand article on this. It can get really confusing when trying to explain it – but you did a great job. Thank you!

    java training in annanagar | java training in chennai

    java training in marathahalli | java training in btm layout

    java training in rajaji nagar | java training in jayanagar


  27. Very good brief and this post helped me alot. Say thank you I searching for your facts. Thanks for sharing with us!

    angularjs-Training in velachery

    angularjs-Training in annanagar

    angularjs Training in chennai

    angularjs Training in chennai

  28. Hello! This is my first visit to your blog! We are a team of volunteers and starting a new initiative in a community in the same niche. Your blog provided us useful information to work on. You have done an outstanding job.

    AWS Training in Rajaji Nagar | Amazon Web Services Training in Rajaji Nagar

    Amazon Web Services Training in Pune | Best AWS Training in Pune

    AWS Online Training | Online AWS Certification Course - Gangboard

  29. I likable the posts and offbeat format you've got here! I’d wish many thanks for sharing your expertise and also the time it took to post!!
    python training in velachery
    python training institute in chennai

  30. Great post! I am actually getting ready to across this information, It’s very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well.

    Devops Training in pune
    DevOps online Training

  31. Read all the information that i've given in above article. It'll give u the whole idea about it.
    Selenium Training in Chennai | Selenium Training in Bangalore |Selenium Training in Pune | Selenium online Training

  32. Amazon Web Services (AWS) is the most popular and most widely used Infrastructure as a Service (IaaS) cloud in the world.AWS has four core feature buckets—Compute, Storage & Content Delivery, Databases, and Networking. At a high level, you can control all of these with extensive administrative controls accessible via a secure Web client.For more information visit aws online

  33. Thank you for your guide to with upgrade information about Hadoop
    Hadoop admin Online Course

  34. Thanks for sharing steps. This is really helpful. Keep doing more.

    Guest posting sites

  35. I love the blog. Great post. It is very true, people must learn how to learn before they can learn. lol i know it sounds funny but its very true. . .
    python training in chennai
    python course in chennai
    python training in bangalore

  36. Some us know all relating to the compelling medium you present powerful steps on this blog and therefore strongly encourage contribution from other ones on this subject while our own child is truly discovering a great deal. Have fun with the remaining portion of the year.

    Selenium training in Chennai | Selenium training institute in Chennai | Selenium course in Chennai

    Selenium training in Bangalore | Selenium training institute in Bangalore | Selenium course in Bangalore

    Selenium interview questions and answers

    Selenium training in Pune | Selenium training institute in Pune | Selenium course in Pune

  37. I found your blog while searching for the updates, I am happy to be here. Very useful content and also easily understandable providing.. Believe me I did wrote an post about tutorials for beginners with reference of your blog.

    rpa training in chennai |rpa course in chennai|
    rpa training in bangalore | best rpa training in bangalore | rpa course in bangalore | rpa training institute in bangalore | rpa training in bangalore | rpa online training

  38. Thank you for allowing me to read it, welcome to the next in a recent article. And thanks for sharing the nice article, keep posting or updating news article.
    Best Devops online Training
    Online DevOps Certification Course - Gangboard

  39. Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article.thank you for sharing such a great blog with us. expecting for your.
    Blue prism training bangalore
    Blue prism classes in bangalore
    Blue Prism Training Centers in Bangalore
    Blue Prism Institute in Bangalore
    Blue Prism Training Institute in Bangalore

  40. Great thoughts you got there, believe I may possibly try just some of it throughout my daily life.
    apple mac service center | apple ipad service center | apple service center | imac service center

  41. I was looking for this certain information for a long time. Thank you and good luck.
    apple mac service center | apple ipad service center | apple service center | imac service center


  42. Whoa! I’m enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appeal. I must say you’ve done a very good job with this.


  43. Goyal packers and movers in Panchkula is highly known for their professional and genuine packing and moving services. We are top leading and certified relocation services providers in Chandigarh deals all over India. To get more information, call us.

    Packers and movers in Chandigarh
    Packers and movers in Panchkula
    Packers and movers in Mohali
    Packers and movers in Zirakpur
    Packers and movers in Patiala
    Packers and movers in Ambala
    Packers and movers in Ambala cantt
    Packers and movers in Pathankot
    Packers and movers in Jalandhar
    Packers and movers in Ludhiana

  44. Thanks for posting helpful blog..keep such kind of blogs...
    aws training in bangalore

  45. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definitely interested in this one. Just thought that I would post and let you know. Nice! thank you so much! Thank you for sharing.
    Website Development Company in Delhi
    Website Designing Company in Delhi
    Mobile App Development Company
    Mobile App Development Company in India


  46. NICE for giving a chance to share ideas for your comuty i really thanks for that great post.
    Best Ice Fishing Gloves Best Ice Fishing Gloves Best Ice Fishing Gloves

  47. Nice post. Thanks for sharing! I want people to know just how good this information is in your article. It’s interesting content and Great work.
    Thanks & Regards,
    VRIT Professionals,
    No.1 Leading Web Designing Training Institute In Chennai.

    And also those who are looking for
    Web Designing Training Institute in Chennai
    SEO Training Institute in Chennai
    Photoshop Training Institute in Chennai
    PHP & Mysql Training Institute in Chennai
    Android Training Institute in Chennai

  48. Its a wonderful post and very helpful, thanks for all this information.
    Vmware Training institute in Noida