Quote:
Originally Posted by Erwin
I modified my vB3 so that URLs are even more search-engine friendly.
Actually, the Google spiders were killing my server, pushing loads up to 20 so I've had to use robots.txt to restrict it. So my page numbers will probably drop, but that's better than my server crashing because of overenthusiastic Googlebots!
|
Hi Erwin,
thanks for the response.
Currently i'm using vB2.3.0 with the
robots.txt Manager. I've modified them so bots can only view showthread.php and now i've to wait till some bots come back and begin spidering.
Maybe we'll get more hits when the upgrade to vB3 is done, but this will not happen until RC1 has released.
-Fish