Google Crawl Rate

[TravG]

Quick question. If your server can handle the load, should you increase your Google Crawl Rate? I can't imagine see how this can hurt but just wanted a second opinion.

Thanks.

[dhayman]

I would say, yes. However, I did this several months ago - I think I tripled the "default" rate, and I haven't seen an appreciative increase in crawling at all. Not sure if this feature is working or not, or if they throttle your spidering due to other factors as well.

[megan isla]

Googlebot is limiting the rate at which it crawls pages on your site to ensure that it does not use too much of your server's resources. If your server can handle additional Googlebot traffic, then Faster crawl but if there's nothing left to crawl, googlebot won't try to crawl foolishly around.

[bbonline]

Well I suggest that it is better to increase the crawl rate, especially if you are regularly updating your website. Since your web server can handle it, then go. Let Google crawl your pages more often as you post your new updates.

[Professor]

Google tends to crawl the sites it feels offer quality content more often than those which are seldom updated and offer outdated information. The more they crawl you the better.

[TravG]

Thanks everyone - thats what I figured - it cant hurt. Since I did increase the crawl rate, both from my stats and from webmasters tools it appears google is crawling my site more often!

[CoopersPick]

the more they crawl the better!

[Karim.ZamaMedia]

The more you are adding new fresh content to your site, the more Google is going to crawl your site.

[martin b]

i don"t think it will change any thing regarding your site, google will not crowl it more

[TravG]

It could just be a coincedence, but since I increased my crawl rate Google has been crawling my site more. I see this through both webmasters tools and my stats from my website. Again, could be a coincedence, but I would say by adjusting the crawl rate google does hit your site more often.