Do robots.txt and robots Meta Tags interfer ?

  • CyberChris
  • Newbie
  • Newbie
  • No Avatar
  • Joined: May 06, 2006
  • Posts: 9
  • Loc: Vancouver Canada
  • Status: Offline

Post July 11th, 2006, 8:58 am

Hi there,
Does anybody know if it is possible to combine robots.txt and robots meta tags or does one or the other overrule ?

Let´s say I would place a robots.txt like this

User-agent: *
Disallow: /secret/

This would allow robots to access everything BUT the /secret/ directory.

Now, I would have the following Meta Tag on a page that is generally allowed by robots.txt:

<META name="ROBOTS" content="noindex, nofollow">

What would the robot do ? Would it obey the meta tag or would the robots.txt overrule the meta command ?

Looking forward to your answers.
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post July 11th, 2006, 8:58 am

  • remaxactionfirst
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Sep 15, 2006
  • Posts: 105
  • Status: Offline

Post September 20th, 2006, 2:28 am

it robots will follow only your index page

Post Information

  • Total Posts in this topic: 2 posts
  • Users browsing this forum: No registered users and 26 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.