Unknown Bspider bot crawling my site 3x more than Google

  • Teen Geek
  • Born
  • Born
  • Teen Geek
  • Posts: 2

Post 3+ Months Ago

A bot called Bspider is crawling my site 3 time more than Google does. Which company owns this bot?
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • Don2007
  • Web Master
  • Web Master
  • Don2007
  • Posts: 4924
  • Loc: NY

Post 3+ Months Ago

http://www.robotstxt.org/db/bspider.html

It seems to be a Japanese bot.
  • Teen Geek
  • Born
  • Born
  • Teen Geek
  • Posts: 2

Post 3+ Months Ago

Thanks!
  • joebert
  • Fart Bubbles
  • Genius
  • User avatar
  • Posts: 13502
  • Loc: Florida

Post 3+ Months Ago

I'm curious what the exact user-agent string you're seeing is.

Post Information

  • Total Posts in this topic: 4 posts
  • Users browsing this forum: No registered users and 7 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
cron
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.