< Back to Blog

Yahoo! Uses Distributed Computing to Speed up Search Index Processing
Tue, 26 Feb 2008 10:18:56 by Kerry Dye

After wading through the official blogs http://www.ysearchblog.com/archives/000521.html on this subject, which mainly deal with the fact it is the world's largest Hadoop installations, I've got a few interesting facts from the SEO point of view.

  • The Webmap (which is the database that feeds their algorithm) now generates in a third less time than it did before
  • It keeps track of roughly 1 trillion links
  • It uses 10,000 Linux cores (which doesn't mean 10,000 computers or even 10,000 processors, as processors are multi-core, but I guess it makes a nice round number)

So hopefully that's some information that might actually be of use when talking to someone non-technical or if you have a need to discuss it with a client.



Kerry Dye
Campaign Delivery Manager


Subscribe

Archives

Related Blogs
How to see country specific search results in MSN/Live Search
Fri, 9 May 2008 15:46:00 by Kerry Dye
Bad Linking and the Worlds Worst SERP Snippet
Tue, 6 May 2008 12:48:23 by Joe Bursell
Spam Factory Websites
Fri, 2 May 2008 14:16:40 by Joe Bursell
3 Way Link Exchange Being Abused by Unethical SEOs
Fri, 2 May 2008 13:22:34 by Kerry Dye
Warning: Two Ways of Killing Your Organic Rankings in Google
Wed, 30 Apr 2008 15:14:00 by Kerry Dye
How Local Search will change how we use the Internet
Tue, 29 Apr 2008 14:29:29 by Matt Hopkins
Google's Website Optimizer Tool Now Available to All
Mon, 21 Apr 2008 14:39:44 by Matt Hopkins