Back To Other Search Engines & Directories

Really low bot / spider activity about new year???

  • vision
  • Beginner
  • Beginner
  • User avatar
  • Joined: May 20, 2004
  • Posts: 57
  • Loc: Maryland
  • Status: Offline

Post January 3rd, 2005, 1:31 am

Anyone else noticed that bot / spider activity has dropped to almost nothing. For the last month I have seen an average of 1500 - 2000 hits from bots to my sites on a daily basis.

Now, since about the Dec. 21 the traffic started to drop down to about 200 - 300 hits per day.

Since Dec. 31st - Jan 2nd, I've recorded absolutly no visits from bots...

I know people take time off around this time of year, but do they shut down the bots as well?
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post January 3rd, 2005, 1:31 am

  • ZenSEO
  • Student
  • Student
  • No Avatar
  • Joined: Oct 15, 2004
  • Posts: 71
  • Status: Offline

Post January 3rd, 2005, 9:01 am

me too... google hasn't even visited my site that was updated almost daily in their cache since Dec 26... it's killing me cuz i've added new sites i want it to pick up the links to but it hasn't come back yet :) i'm guessing it's because of the PR update.
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 3rd, 2005, 9:37 am

I've noticed it as well. My stab-in-the-dark guess (at least for Google) is that they are focusing a bit on security at the moment:
http://asia.cnet.com/news/security/0,39 ... 616,00.htm
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 3rd, 2005, 3:03 pm

Inktomi just kicked in. They are on the prowl now.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 3rd, 2005, 6:53 pm

still waiting for th bots to start attacking my site again
  • Swan
  • Student
  • Student
  • User avatar
  • Joined: Nov 27, 2004
  • Posts: 96
  • Loc: Idaho
  • Status: Offline

Post January 3rd, 2005, 9:12 pm

Dumb question here, how do you know when they are? and where do I get the tool?


Swan
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 4th, 2005, 7:07 am

You get used to the IP's

A few IP blocks I know are

MSN - 65.52.0.0 -- 65.55.255.255
Inktomi - 66.196.64.0 -- 66.196.127.255
Google - 66.249.64.0 -- 66.249.95.255

Usually your weblogs will identify the bots also.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 4th, 2005, 8:19 am

i normally use awstats which comes with my cpanel hosting to identify the bots.

Looks like msn are back on the prowl
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 4th, 2005, 12:05 pm

update yahoos bot seem to be on the move
  • vision
  • Beginner
  • Beginner
  • User avatar
  • Joined: May 20, 2004
  • Posts: 57
  • Loc: Maryland
  • Status: Offline

Post January 6th, 2005, 8:18 pm

Swan wrote:
Dumb question here, how do you know when they are? and where do I get the tool?


Swan


In my case, I have built extensive reporting and tracking of bots and any traffic that comes to my site via search engines.

I can look at any bot by day, for any of my sites. I can also see traffic from search engines, all keywords and phrases used. Its quite interesting stuff - flash bases graphs, drill downs - fun stuff!
  • madmonk
  • Mastermind
  • Mastermind
  • No Avatar
  • Joined: May 04, 2004
  • Posts: 2115
  • Loc: australia
  • Status: Offline

Post January 7th, 2005, 2:53 am

Cpanel normally comes with your web hosting, Swan. It has stuffs on all these activities :-)
Tattoos Gallery
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 8th, 2005, 11:50 am

Googlebot is active again. Been hitting BR since this morning and made a significant impact on hits. They've almost equalled what Inktomi Slurp took a week to do in just one day.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.

Page 1 of 1

Post Information

  • Total Posts in this topic: 12 posts
  • Users browsing this forum: No registered users and 25 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.