Really low bot / spider activity about new year???

  • vision
  • Beginner
  • Beginner
  • User avatar
  • Posts: 57
  • Loc: Maryland

Post 3+ Months Ago

Anyone else noticed that bot / spider activity has dropped to almost nothing. For the last month I have seen an average of 1500 - 2000 hits from bots to my sites on a daily basis.

Now, since about the Dec. 21 the traffic started to drop down to about 200 - 300 hits per day.

Since Dec. 31st - Jan 2nd, I've recorded absolutly no visits from bots...

I know people take time off around this time of year, but do they shut down the bots as well?
  • ZenSEO
  • Student
  • Student
  • ZenSEO
  • Posts: 71

Post 3+ Months Ago

me too... google hasn't even visited my site that was updated almost daily in their cache since Dec 26... it's killing me cuz i've added new sites i want it to pick up the links to but it hasn't come back yet :) i'm guessing it's because of the PR update.
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23454
  • Loc: Woodbridge VA

Post 3+ Months Ago

I've noticed it as well. My stab-in-the-dark guess (at least for Google) is that they are focusing a bit on security at the moment:
http://asia.cnet.com/news/security/0,39 ... 616,00.htm
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23454
  • Loc: Woodbridge VA

Post 3+ Months Ago

Inktomi just kicked in. They are on the prowl now.
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

still waiting for th bots to start attacking my site again
  • Swan
  • Student
  • Student
  • User avatar
  • Posts: 96
  • Loc: Idaho

Post 3+ Months Ago

Dumb question here, how do you know when they are? and where do I get the tool?


Swan
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23454
  • Loc: Woodbridge VA

Post 3+ Months Ago

You get used to the IP's

A few IP blocks I know are

MSN - 65.52.0.0 -- 65.55.255.255
Inktomi - 66.196.64.0 -- 66.196.127.255
Google - 66.249.64.0 -- 66.249.95.255

Usually your weblogs will identify the bots also.
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

i normally use awstats which comes with my cpanel hosting to identify the bots.

Looks like msn are back on the prowl
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

update yahoos bot seem to be on the move
  • vision
  • Beginner
  • Beginner
  • User avatar
  • Posts: 57
  • Loc: Maryland

Post 3+ Months Ago

Swan wrote:
Dumb question here, how do you know when they are? and where do I get the tool?


Swan


In my case, I have built extensive reporting and tracking of bots and any traffic that comes to my site via search engines.

I can look at any bot by day, for any of my sites. I can also see traffic from search engines, all keywords and phrases used. Its quite interesting stuff - flash bases graphs, drill downs - fun stuff!
  • madmonk
  • Mastermind
  • Mastermind
  • madmonk
  • Posts: 2115
  • Loc: australia

Post 3+ Months Ago

Cpanel normally comes with your web hosting, Swan. It has stuffs on all these activities :-)
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23454
  • Loc: Woodbridge VA

Post 3+ Months Ago

Googlebot is active again. Been hitting BR since this morning and made a significant impact on hits. They've almost equalled what Inktomi Slurp took a week to do in just one day.

Post Information

  • Total Posts in this topic: 12 posts
  • Users browsing this forum: No registered users and 5 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.