Alexa (IA Archiver)

  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

Is this a important bot to have index your site?

for this month alone the alexa bot is killing my bandwidth.

heres the stats

Alexa (IA Archiver)
hits - 1773
Bandwidth Usage - 41.52 MB

Compared 2

Inktomi Slurp
hits - 1853
Bandwidth Usage - 11.34 MB

Any info will be helpfull :D
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23455
  • Loc: Woodbridge VA

Post 3+ Months Ago

As best as I can tell Alexa uses Google results for the search, but they spider the pages primarily for archive.org

http://www.archive.org/about/faqs.php#2
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

thx for the above.

i though alexa used google results aswell.

Any info on whether this bot is a usefull one or whether i can disallow it without losing out.

thanks
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23455
  • Loc: Woodbridge VA

Post 3+ Months Ago

Did you read archive.org? I guess it just depends on whether you want the benefit of the cached copies of your site. Personally, I've never been fond of Alexa and every spyware removal tool I use ID's them as spyware. There are arguments for and against and some discussion is already archived at OZZU and can be found via search.
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

yeah alexa always shows up as spyware 4 me aswell.

well before i block the alexa bot from my site im gonna wait and see if any else has anything good to say about alexa and the alexa bot
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Posts: 23455
  • Loc: Woodbridge VA

Post 3+ Months Ago

Here are my complete thoughts on them:
http://www.ozzu.com/other-search-engines/alexa-experiment-t31830.html

As an added note, I have not blocked the bot.

For more reading simply type Alexa into OZZU's search.
  • meman
  • Web Master
  • Web Master
  • User avatar
  • Posts: 3432
  • Loc: London Town , Apples and pears and all that crap

Post 3+ Months Ago

the google script i have on my site uses alexa for the thumbnails
Search for OZZU
  • djtheropy
  • Graduate
  • Graduate
  • djtheropy
  • Posts: 111

Post 3+ Months Ago

thanks 4 the above i did abit of searching and found this

http://www.searchenginegenie.com/Danger ... agents.htm

it has ia_archiver as a useless bot so i think that answers my questions.

thanks

Post Information

  • Total Posts in this topic: 8 posts
  • Users browsing this forum: No registered users and 6 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.