DHTML Menu /Javascript effects on bots ability to spider.

  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 26th, 2004, 1:42 pm

I started thinking about this a little bit ago when I was creating some redirect pages for some outdated pages that are no longer available but still show up on search engine results and many people probably have some of the older pages bookmarked.

I'm using a DHTML menu, which is basically two javascripts. One stores the functions that make the menu work and the other stores the href data. Typically I'll use the meta tag to instruct robots to index,follow, but I started thinking - how will they be able to "follow" when I have no links on the page itself to follow? Will they extract the links from the javascript file? I'm thinking probably not.

Because of the complexity of the site, I have no text links on the page, but use the one menu, since an easy edit to the js file changes the menu for the entire site. I also don't have a site map page, but now I'm thinking that might not be such a bad idea.

Thanks for any advice.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • Anonymous
  • Bot
  • No Avatar
  • Joined: 25 Feb 2008
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post January 26th, 2004, 1:42 pm

  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post January 31st, 2004, 8:54 am

I did find somewhat of an answer and solution to this. Apparently the answer is no, they will not index the links in the external .js files so without any actual hypertext links on the site, they won't spider past the index page. I discovered this when indexing my site with a search proggie I found called ZoomSearch, and testing it with some online search optimization stuff.

The temporary solution was to put all the links to every page to the site in SGML comments in the head examlple--

Code: [ Select ]
<head>
<!-- <a href="http://www.google.com">.</a>
<a href=""http://www.yahoo.com">.</a>
-->
</head>
  1. <head>
  2. <!-- <a href="http://www.google.com">.</a>
  3. <a href=""http://www.yahoo.com">.</a>
  4. -->
  5. </head>


Now that that's temporarily solved it gives me more time to create a better design.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • Johan007
  • Guru
  • Guru
  • User avatar
  • Joined: Sep 17, 2003
  • Posts: 1080
  • Loc: Aldershot, UK
  • Status: Offline

Post February 3rd, 2004, 4:44 am

Google does NOT execute java script or HTML it only reads.

It reads a href as a link but does not know to ignore it cos it don’t execute the surroundings like Java Script. I am not sure but it may not even execute <!-- -->
Read my Movie Reviews punk!
  • SEO Guy
  • Beginner
  • Beginner
  • User avatar
  • Joined: Feb 02, 2004
  • Posts: 47
  • Loc: Canada
  • Status: Offline

Post February 3rd, 2004, 2:33 pm

Google does not parse comment tags at all due to abuse in SEO some 2 years back. Those links wont be spidered in the head you will need to find and text or image link alternative or simply integrate a text link based site map from the footer of each page, this is suggested in Googles suggestions for webmasters as well.

No matter what design you have "sitemap" link in the footer is always integratable
  • Johan007
  • Guru
  • Guru
  • User avatar
  • Joined: Sep 17, 2003
  • Posts: 1080
  • Loc: Aldershot, UK
  • Status: Offline

Post February 3rd, 2004, 4:22 pm

Thats a well nice website you have seo-guy.com PR8 too :shock:
- May I say .. consider changing the font to verdana apart from the massive text "Contact SEO Guy today!" to be in Ariel. (Trust me!)
Read my Movie Reviews punk!
  • ATNO/TW
  • Super Moderator
  • Super Moderator
  • User avatar
  • Joined: May 28, 2003
  • Posts: 23404
  • Loc: Woodbridge VA
  • Status: Offline

Post February 3rd, 2004, 5:03 pm

Thanks for the input folks. My intent is to redo the site anyway, but I needed to figure out some solutions for the DHTML menu stuff. Much appreciated.
"There's no place like 127.0.0.1 except for ::1."
Alexandria Networks. Leader in IT consulting for associations/non-profits, and small to medium sized businesses around the northern Virginia and Washington D.C. metro area.
  • SEO Guy
  • Beginner
  • Beginner
  • User avatar
  • Joined: Feb 02, 2004
  • Posts: 47
  • Loc: Canada
  • Status: Offline

Post February 3rd, 2004, 5:21 pm

ITsa ll Good Johan thanks for the props but I am redesigning completely with unflux right now jsut wait a week or 2 and that PR 8 site will do itrself justice
Cheers
  • UNFLUX
  • Genius
  • Genius
  • User avatar
  • Joined: Dec 20, 2002
  • Posts: 6382
  • Loc: twitter.com/unflux
  • Status: Offline

Post February 3rd, 2004, 6:53 pm

indeed -- and verdana is always my font of choice ;)
UNFLUX.FOTO
  • rjmthezonenet
  • Expert
  • Expert
  • User avatar
  • Joined: Jan 14, 2004
  • Posts: 526
  • Loc: St. John's, Newfoundland, Canada
  • Status: Offline

Post February 3rd, 2004, 9:05 pm

ATNO/TW wrote:
Because of the complexity of the site, I have no text links on the page, but use the one menu, since an easy edit to the js file changes the menu for the entire site. I also don't have a site map page, but now I'm thinking that might not be such a bad idea.


What about sniffing the user-agent and substituting a sitemap for the bots.

(I've heard some bots may notice this and will do mean things to your ranking... but, its just a rumor. Does anyone know for sure?)
  • SEO Guy
  • Beginner
  • Beginner
  • User avatar
  • Joined: Feb 02, 2004
  • Posts: 47
  • Loc: Canada
  • Status: Offline

Post February 4th, 2004, 12:06 am

That kind of cloaking is usually not picked up by Google but if you are reported via the spam report your gone!

Post Information

  • Total Posts in this topic: 10 posts
  • Users browsing this forum: No registered users and 21 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 2011 Unmelted, LLC. Ozzu® is a registered trademark of Unmelted, LLC.