not getting deep crawled anymore.

  • floridafishandhunt.com
  • Graduate
  • Graduate
  • User avatar
  • Posts: 130
  • Loc: Florida

Post 3+ Months Ago

My index page used to get crawled every other day and then my whole site would get crawled almost every Friday. So If I added a new article or page on a monday it would get indexed within a week at the most.
This was very steady at first and I never had a problem until about 2 weeks ago. The only thing I did different that I can recall is I added a
bunch of links from my main page to the different forum sections. I did this hoping my forum would start getting crawled regularly. I dont want to say that this is the reason it isnt getting crawled as much but I dont know. Is it possible I have to many links on my main page?

Please take a look at my page and let me know what you think.
Also, I started originally trying to get a lot of backlinks. I got a few and then decided to work on my content hoping the links would come to me.
I realize this idea is a little bit of a pipe dream but I know content is king. I went from a pr of 0 to to a pr of 4 in 4 months. Every update I went up one until the last one. Is going from a 4 to a 5 a big jump?
And, will content make that 4 to 5 jump or is all about the links?

Anyhow, Let me know gurus.
Thanks,
Doug

http://www.floridafishandhunt.com
  • Anonymous
  • Bot
  • No Avatar
  • Posts: ?
  • Loc: Ozzuland
  • Status: Online

Post 3+ Months Ago

  • rtchar
  • Expert
  • Expert
  • User avatar
  • Posts: 606
  • Loc: Canada

Post 3+ Months Ago

You may have told Google not to look at your site?

Quote:
<META content="30 days" name=revisit-after>


I am not sure how closely Google pays attention to META TAGS... Mot people agree that Google ignores the tag if it is set to a short time span, like trying to get indexed every day.

Is this tag a recent addition?

Does anyone know if this is true for longer periods?
  • floridafishandhunt.com
  • Graduate
  • Graduate
  • User avatar
  • Posts: 130
  • Loc: Florida

Post 3+ Months Ago

I honestly dont remember if that has always been there or not.

I wonder if that has something to do with it? I edit everything with dreamwaever I wonder if I somehow added that.
I will investigate.
-D-
  • floridafishandhunt.com
  • Graduate
  • Graduate
  • User avatar
  • Posts: 130
  • Loc: Florida

Post 3+ Months Ago

well, it looks like its always been set to 30 days. I then went and did a search and found that google just indexed 150 or so pdf documents I have had online for about two months. Not sure should I change that to like 7 days or something?

Doug
  • rtchar
  • Expert
  • Expert
  • User avatar
  • Posts: 606
  • Loc: Canada

Post 3+ Months Ago

Well Doug it looks like you answered MY question :)

Google ignores the tag regardless of the length of time ...


Other than that everything looked just fine.

My site hasn't been deep crawled since 06/09/04. Guess they were just too busy doing a PR update. :D
  • CazpianXI
  • Proficient
  • Proficient
  • User avatar
  • Posts: 285

Post 3+ Months Ago

Try making a site map for your site. This might help your problem

Hope this helps.

~Cazpian the 11th
  • rtchar
  • Expert
  • Expert
  • User avatar
  • Posts: 606
  • Loc: Canada

Post 3+ Months Ago

Not sure there is any benefit to a site map ... except to increase your page count. :wink:

Googlebot dropped by this morning, and did 'his' thing. So I guess they are back on track.
  • floridafishandhunt.com
  • Graduate
  • Graduate
  • User avatar
  • Posts: 130
  • Loc: Florida

Post 3+ Months Ago

Three things.

First thanks for everyones input.

Second, I did notice that pretty much every page on my site
increased to a pr of 3 verse a bunch of 2's and 0's.
I think this is good. From a SEO viewpoint is it bad to have all
internal pr go up and the main stays the same?

Lastly, I noticed a couple of days ago that google was on my forums crawling. I saw google crawlers 10 11 12 and 14 I think all in the same day. The were in the different sections of my forums. My question is once google crawls does this mean those pages will DEFINATELY get listed and if so does it happen right away or can it take a while. I assume it may take awhile because I havent had any new pages added since the crawl.

Can I get a BONUS question?

I noticed before the update a couple of days ago that my cached snapshot was fairly current. after the update a much outdated cached snapshot was present. Why is that?

Thanks again to all those that have helped me.
I have all of you to owe for my site even being on the internet.

Doug
  • rtchar
  • Expert
  • Expert
  • User avatar
  • Posts: 606
  • Loc: Canada

Post 3+ Months Ago

Doug

Quote:
From a SEO viewpoint is it bad to have all
internal pr go up and the main stays the same?


I don't know if it so bad ... I got ten PR-4 back links from within my own site. You know how much work it is to get ten PR-4 links! :D

I know it takes exactly four days after Google crawls my site until the results appear. I am sure of this because I have a dynamic date appearing on a couple pages. So the date shows up on the cached page. :)

From what I understand there is NO guarantee that any/all pages crawled will appear in the index. There are many stories in this forum where Googlebot visits sites regularly and never indexes any pages.

As far as the cached snapshot ... I am sure someone will write it off to the 'Google Dance', (this normally happens, as servers try to sync, after major updates). Ignore it and it will go away. :lol:

Post Information

  • Total Posts in this topic: 9 posts
  • Users browsing this forum: No registered users and 8 guests
  • You cannot post new topics in this forum
  • You cannot reply to topics in this forum
  • You cannot edit your posts in this forum
  • You cannot delete your posts in this forum
  • You cannot post attachments in this forum
 
 

© 1998-2014. Ozzu® is a registered trademark of Unmelted, LLC.