My question really is why do the spiders need to crawl it so often, of course we all want to be found in the search engines but really 50-60 spiders every hour is a bit strange, is it normal, am I have less or more than others?
I have a small non profit site that I am trying to grow and I don't want all my sql queries being used by spiders and yet I still want to be found by the search engines, i would love a vps but couldn't afford to sustain one... I have reseller hosting with Hostgator...
|