< Back to Blog

Common reasons why sites do not get indexed
Wed, 21 Feb 2007 09:20:16 by Hannah Parker

Sometimes we evaluate sites which are not indexed in some search engines or are ranking very poorly.

 

This MIGHT be because they?ve been banned for dastardly  spamming techniques like heavy interlinking between domains or it might be because the site is brand new - alternatively it might be due to technical issues which we can advise on.

 

A big problem is sites that are geographically targeted but hosted in the wrong country or with the wrong domain suffix. For example if a site is hosted in Germany or Sweden and has a .com suffix, but aimed at the UK audience, it is unlikely to rank in the UK.

 

You can find out quickly what country a site is hosted in by using:

 

http://news.netcraft.com/

 

Another good reason why sites aren?t indexed is if there are duplicate sites around which all appear to be serving the same content. There are several ways this might have come about - sometimes people register several domains and set up server aliases, sometimes one domain forwards to another using frames, sometimes the redirect is a 301 permanent redirect and sometimes it?s a 302 temporary redirect. Ideally we want a 301 permanent redirect.

 

Server aliases appear to search engines like the worst form of duplicate content - in this instance a server header check returns and HTTP code of 200 (OK) and a search engine will index one domain but ignore all the others - or at best, index the homepage.

 

The quickest way of finding out what?s going on - in my opinion - is to use a tool like:

 

http://web-sniffer.net/

 

It gives you a server header check - you?re looking for a HTTP status code of 200?or 301? a 302 suggests a problem

 

It also gives you the HTML for the URL ? this is a good way of instantly diagnosing a site that uses Frame forwarding.

 

It tells you what the server is running e.g. IIS or Apache and also lets you see what scripting is enabled like ASP or PHP?

 

 



Hannah Parker
Campaign Delivery Manager


Subscribe

Archives

Related Blogs
Micro sites - the impact on your search engine optimisation
Mon, 21 Jul 2008 16:09:05 by Emily Mace
Wikia Search- update
Mon, 21 Jul 2008 15:07:00 by Joe Bursell
Sharing SEO knowledge
Fri, 18 Jul 2008 14:12:44 by Joe Bursell
Greasemonkey Script for Live.com Search
Fri, 18 Jul 2008 13:55:26 by Kerry Dye
Growth in Online shopping in the UK highlights the importance of SEO
Fri, 18 Jul 2008 10:46:02 by Emily Mace
Search Engine Optimisation is not a commodity
Wed, 9 Jul 2008 15:29:23 by Emily Mace
Grouped Results in Google - The Elastic Band Effect
Tue, 8 Jul 2008 15:26:04 by Kerry Dye