Google Spiders half the site... www.earborist.com

  • webmaster
  • Born
  • Born
  • webmaster
  • Posts: 1

Post 3+ Months Ago

Hi All,

I wonder if any one can offer advice. We have a site http://www.earborist.com and am having troubloe getting google to spider the whole site. at present pages...

http://www.earborist.com/about.php
http://www.earborist.com/help.php
http://www.earborist.com/multitip.php

are being spidered almost every day, but our adverts (you can see them if you use the search button) and our home page http://www.earborist.com are very rarely being visited.

I assumed that if the bot was on my site it would index the whole site. Can anyone help?

Why doesn't google like me :-(
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • reciprocal
  • Novice
  • Novice
  • User avatar
  • Posts: 19
  • Loc: Bemidji, MN 56601

Post 3+ Months Ago

Have you tried using a robot.txt file?
  • Dubya
  • Proficient
  • Proficient
  • User avatar
  • Posts: 468

Post 3+ Months Ago

curious, cause I have a similar problem. What does a robot.txt file do.
  • madmonk
  • Mastermind
  • Mastermind
  • madmonk
  • Posts: 2115
  • Loc: australia

Post 3+ Months Ago

a robot.txt simply tells which pages the spider can visit and it can also block certain spiders from entering yr site..(in short)

It also takes a while for your home page to be indexed by google. how old is your site? it doesnt look new.

perhaps a signature in ozzu will create some more activity to yr site... :-)
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

Would this meta tag be the problem?
<META NAME="robots" CONTENT="FOLLOW,INDEX">

shouldnt it be
<META NAME="robots" CONTENT="INDEX,FOLLOW">

cos by the looks of it its following links but no indexing them.
  • Jess
  • Guru
  • Guru
  • User avatar
  • Posts: 1153
  • Loc: USA

Post 3+ Months Ago

http://www.infocopter.com/know-how/robots.htm

Indeed it should :)

Post Information

  • Total Posts in this topic: 6 posts
  • Users browsing this forum: No registered users and 5 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.