Vertical Leap's management tool Apollo gives real-time access to our account so we can see ranking changes as they happen
| 3 ways to stop your web pages being indexed |
| Wed, 09 Dec 2009 by Tom Hallett One of the main aims of SEO is to increase the visibility of your website in the search engines so you get more visitors to your pages from organic search. However, there may be times when you want to stop some (or maybe all) of your pages from being indexed in the search engine results pages (SERPs). Maybe parts of your site are duplicated (like ‘print friendly’ pages). Or you might want to stop search results pages from your internal search being indexed. Here are 3 ways to stop a web page from being indexed: 1. Robots.txt Before a search engine bot crawls your website, they will look for a text file at the root of your domain. The robots.txt should tell them what pages they are allowed to index when they crawl the site. However, some robots may ignore the robots.txt. And it’s not a good idea to block ‘secret’ pages using robots.txt as anyone can access it at www.yourdomain.com/robots.txt and see what pages you’ve blocked. 2. ‘Noindex’ metatag The noindex metatag looks like this: <meta name=”robots” content=”noindex”> Simply add this code in the <head> section on any pages you don’t want indexed. However, you can only use this on html pages – you won’t be able to use the noindex tag to block out PDFs, Flash files or Word Documents etc. Be aware that some bots will continue to index pages with the noindex metatag. And it’s not a reliable way to make links on a page ‘nofollow’. 3. Password protect pages If you have pages that you only want certain people to access, password protecting them will restrict access to unwanted visitors and the search engine bots. This is a good solution for restricting sections of your site that are in development. |
Blog Feed Subscription
Archives
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
