How deeply does Google crawl sites?

  • john5269
  • Graduate
  • Graduate
  • john5269
  • Posts: 198

Post 3+ Months Ago

Hi,

I have a site that has been on the Web for over 2 years. I have added new parts to the site, where Google would have to crawl through a few pages to get there.

I found that google would crawl my site as follows:

Homepage which links to a Games Directory - Google Crawls

Games Directory which links to a Action Games Section - Google Crawls

Action Games Section which links to games where you can play - Google Crawls

Action Games Section page 2 which links to games - Google Does Not Crawl

Does anybody know why google doesn't crawl this deep into my site?

I was using dynamic links, but now I have changed them to search engine friendly links by using mod rewrite and Google still doesn't crawl any further.

The only thing that I can think of trying out is by using a site map on my site. Would anybody suggest this as being a Google approach?
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • discountdomains
  • Graduate
  • Graduate
  • discountdomains
  • Posts: 171
  • Loc: Telford UK

Post 3+ Months Ago

I would definitely add a sitemap, and link it from your home page.

e.g http://www.discountdomainsuk.com/sitemap.php

Clare
  • john5269
  • Graduate
  • Graduate
  • john5269
  • Posts: 198

Post 3+ Months Ago

discountdomains wrote:
I would definitely add a sitemap, and link it from your home page.

e.g http://www.discountdomainsuk.com/sitemap.php

Clare


Thanks for the reply!

I have now already made a site map. Infact, I had done it a few days before your reply as I had some positive feedback from some of the other forums.
  • phaugh
  • Professor
  • Professor
  • User avatar
  • Posts: 796

Post 3+ Months Ago

"The only thing that I can think of trying out is by using a site map on my site." Excellent idea.

You could also do two other things....1) put links to some of those deeper section on your index page...somewhere at the bottom of the page by your current footer.....2) Get links from other sites with good PR that point to the pages deeper in your site...this will get the crawlers there and from there they might dig even deeper.

Good idea getting rid of the dynamic urls...google doesn't do well with them. How long ago did you implement the the mod-rewrite?
  • john5269
  • Graduate
  • Graduate
  • john5269
  • Posts: 198

Post 3+ Months Ago

phaugh wrote:
"The only thing that I can think of trying out is by using a site map on my site." Excellent idea.

You could also do two other things....1) put links to some of those deeper section on your index page...somewhere at the bottom of the page by your current footer.....2) Get links from other sites with good PR that point to the pages deeper in your site...this will get the crawlers there and from there they might dig even deeper.

Good idea getting rid of the dynamic urls...google doesn't do well with them. How long ago did you implement the the mod-rewrite?


I got rid of the dynamic urls about three weeks back know, but I still have a few dynamic urls in places. These are on the pages that have numbers down the botton of the pages so that you can go to the next page, previous page, etc. I could not manage to mod rewrite most of these, but I am working on doing it very soon.

Personally I found that most of my pages where listed within Google, even the dynamic urls, but the deeper ones within my site weren't. That was the main reasons for me doing mod rewrite. After mod rewrite, I have not seen any improvements to my traffic yet, but then I have only just done the mod rewrite.
  • phaugh
  • Professor
  • Professor
  • User avatar
  • Posts: 796

Post 3+ Months Ago

3 weeks is a short time in google's ability to add new pages and rank them high...give it some time...your on the right track!
  • discountdomains
  • Graduate
  • Graduate
  • discountdomains
  • Posts: 171
  • Loc: Telford UK

Post 3+ Months Ago

Yeah be patient, I normally allow at least a month or so for new content to get added if its a few levels deep.

Clare

Post Information

  • Total Posts in this topic: 7 posts
  • Users browsing this forum: No registered users and 7 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
cron
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.