any search engine bot user agent string collection?

  • pedrotuga
  • Proficient
  • Proficient
  • User avatar
  • Joined: Apr 19, 2005
  • Posts: 315
  • Status: Offline

Post November 30th, 2006, 2:19 am

I need to make some links showing only to search engine bots.

Does anybody has a list?
Rapidshare search engine
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post November 30th, 2006, 2:19 am

  • meman
  • Web Master
  • Web Master
  • User avatar
  • Joined: Aug 03, 2004
  • Posts: 3432
  • Loc: London Town , Apples and pears and all that crap
  • Status: Offline

Post November 30th, 2006, 3:28 am

Expect to be banned from google in about a month if you do find the list.
GodBeGone - Atheist Blog
  • pedrotuga
  • Proficient
  • Proficient
  • User avatar
  • Joined: Apr 19, 2005
  • Posts: 315
  • Status: Offline

Post November 30th, 2006, 6:30 am

meman wrote:
Expect to be banned from google in about a month if you do find the list.


? how come? i mean how and why is that ilegal? Google recomends webmasters to keep the urls sharp as they are indexed.

Then only thing i want to do is to include links to dynamic pages that otherwise wouldnt bee linked.
Rapidshare search engine
  • meman
  • Web Master
  • Web Master
  • User avatar
  • Joined: Aug 03, 2004
  • Posts: 3432
  • Loc: London Town , Apples and pears and all that crap
  • Status: Offline

Post November 30th, 2006, 7:31 am

Google would see it as cloaking. They ban people for it.
You would be better of including these URLs in a sitemap page that is available to everyone. Why would you only want google to see these pages and not your visitors?
GodBeGone - Atheist Blog
  • pedrotuga
  • Proficient
  • Proficient
  • User avatar
  • Joined: Apr 19, 2005
  • Posts: 315
  • Status: Offline

Post November 30th, 2006, 10:26 am

Mmmm i see.
I dont like they way we all got so dependent on google :(. Well...
a good old sitemap, i think you are right.

tahnks.

BTW, why is cloaking worthing a ban? like... i think the use of modrewrite for example is more powerfull and and google still recomends it.
Rapidshare search engine
  • meman
  • Web Master
  • Web Master
  • User avatar
  • Joined: Aug 03, 2004
  • Posts: 3432
  • Loc: London Town , Apples and pears and all that crap
  • Status: Offline

Post November 30th, 2006, 12:32 pm

They don't like cloaking because it means what google bot sees isn't going to be what a visitor sees when google send them to the site.
GodBeGone - Atheist Blog
  • Microsys
  • Novice
  • Novice
  • User avatar
  • Joined: Jul 25, 2006
  • Posts: 28
  • Status: Offline

Post January 14th, 2007, 5:26 pm

Well, make a HTML sitemap and then generate a Google XML sitemap

you can see more at http://www.sitemaps.org
A1 Website Analyzer - Fix broken links, duplicate titles, custom search...
A1 Sitemap Generator - Create HTML/CSS, image, video and XML sitemaps...

Post Information

  • Total Posts in this topic: 7 posts
  • Users browsing this forum: No registered users and 20 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
cron
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.