A question on robots.txt file!

  • 3DProf4online
  • Beginner
  • Beginner
  • 3DProf4online
  • Posts: 41

Post 3+ Months Ago

Hey guys, I just would like to discuss with what benefits can be gained from robots.txt file when promoting website? Could you please explain how to upload this file to hosting? Is it uploaded to public_html root directory as well?
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • Don2007
  • Web Master
  • Web Master
  • Don2007
  • Posts: 4924
  • Loc: NY

Post 3+ Months Ago

The purpose of a robots.txt file is to stop bots from crawling parts of your site that you want to keep private. However, at the same time, it's telling the world where those private things are located. From a security point of view, there are people who look for the robots.txt file if they have some interest in compromising your site. I wouldn't use it.

Post Information

  • Total Posts in this topic: 2 posts
  • Users browsing this forum: No registered users and 6 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.