Yahoo to distrbute its version of Hadoop

By Tom Krazit, CNET News.com
Thursday, June 11, 2009 11:13 AM

Yahoo announced plans Wednesday to release an open source version of its take on Hadoop, a grid-computing framework used to run many parts of its business.

Yahoo is a major force in the development of Hadoop, which is principally overseen by the Apache Software Foundation. Hadoop is essentially an open source version of the software Google uses to run its Web indexing servers, and Yahoo uses it for much the same purpose internally.

Hadoop runs on tens of thousands of servers inside Yahoo, said Nigel Daley, quality and release engineering manager for Yahoo Grid Technologies, in a blog post Wednesday. That's a much larger implementation than other companies and organizations might wish to deploy, but at the same time they would like to benefit from the reliability tweaks that Yahoo has made to Hadoop in order to support its enormous Web properties.

"This distribution is largely a response to the numerous requests that we have received to share Yahoo!'s internally tested and scale-proven releases," Daley wrote.

This article was first published as a blog post on CNET News.


WORTHWHILE?

0

0 votes
Blog

Talkback 0 comments

There are currently no comments for this post.


Tech Jobs Now!

Search for your ideal tech job:

Use shades of gray to enhance scale in Excel

Microsoft Office Suite

Excel's palette is generous, but don't throw buckets of pigment all over your spreadsheets just because you can.


Read more »



Ultimate 2012 recovery site: the moon

Blog thumbnail

Have you seen the disaster movie "2012"? A friend from Control Risks and I did, and we reluctantly concluded we wouldn't be able to write off the cost of our..... by Nathaniel Forbes

Read more »

Tags

  1. antivirus
  2. apple ipod
  3. cnet networks inc.
  4. desktop
  5. e - mail
  6. hard drive
  7. intuit inc.
  8. mcafee inc.
  9. microsoft corp.
  10. microsoft windows
  11. microsoft windows vista
  12. microsoft windows xp
  13. norton co.
  14. pc
  15. performance
  16. security
  17. software
  18. tool
  19. web
  20. web site