Alexa (IA Archiver)

  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 9th, 2005, 11:03 am

Is this a important bot to have index your site?

for this month alone the alexa bot is killing my bandwidth.

heres the stats

Alexa (IA Archiver)
hits - 1773
Bandwidth Usage - 41.52 MB

Compared 2

Inktomi Slurp
hits - 1853
Bandwidth Usage - 11.34 MB

Any info will be helpfull :D
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post January 9th, 2005, 11:03 am

  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 9th, 2005, 1:13 pm

As best as I can tell Alexa uses Google results for the search, but they spider the pages primarily for archive.org

http://www.archive.org/about/faqs.php#2
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 9th, 2005, 2:02 pm

thx for the above.

i though alexa used google results aswell.

Any info on whether this bot is a usefull one or whether i can disallow it without losing out.

thanks
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 9th, 2005, 2:25 pm

Did you read archive.org? I guess it just depends on whether you want the benefit of the cached copies of your site. Personally, I've never been fond of Alexa and every spyware removal tool I use ID's them as spyware. There are arguments for and against and some discussion is already archived at OZZU and can be found via search.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 9th, 2005, 3:30 pm

yeah alexa always shows up as spyware 4 me aswell.

well before i block the alexa bot from my site im gonna wait and see if any else has anything good to say about alexa and the alexa bot
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 9th, 2005, 3:35 pm

Here are my complete thoughts on them:
http://www.ozzu.com/other-search-engines/alexa-experiment-t31830.html

As an added note, I have not blocked the bot.

For more reading simply type Alexa into OZZU's search.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • meman
  • Web Master
  • Web Master
  • User avatar
  • Joined: Aug 03, 2004
  • Posts: 3432
  • Loc: London Town , Apples and pears and all that crap
  • Status: Offline

Post January 9th, 2005, 9:52 pm

the google script i have on my site uses alexa for the thumbnails
Search for OZZU
GodBeGone - Atheist Blog
  • djtheropy
  • Graduate
  • Graduate
  • No Avatar
  • Joined: Nov 05, 2004
  • Posts: 111
  • Status: Offline

Post January 10th, 2005, 4:12 am

thanks 4 the above i did abit of searching and found this

http://www.searchenginegenie.com/Danger ... agents.htm

it has ia_archiver as a useless bot so i think that answers my questions.

thanks

Post Information

  • Total Posts in this topic: 8 posts
  • Users browsing this forum: No registered users and 17 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
cron
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.