Do robots.txt and robots Meta Tags interfer ?

  • CyberChris
  • Newbie
  • Newbie
  • CyberChris
  • Posts: 9
  • Loc: Vancouver Canada

Post 3+ Months Ago

Hi there,
Does anybody know if it is possible to combine robots.txt and robots meta tags or does one or the other overrule ?

Let´s say I would place a robots.txt like this

User-agent: *
Disallow: /secret/

This would allow robots to access everything BUT the /secret/ directory.

Now, I would have the following Meta Tag on a page that is generally allowed by robots.txt:

<META name="ROBOTS" content="noindex, nofollow">

What would the robot do ? Would it obey the meta tag or would the robots.txt overrule the meta command ?

Looking forward to your answers.
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • remaxactionfirst
  • Graduate
  • Graduate
  • remaxactionfirst
  • Posts: 103

Post 3+ Months Ago

it robots will follow only your index page

Post Information

  • Total Posts in this topic: 2 posts
  • Users browsing this forum: No registered users and 5 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
cron
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.