Quote:
Originally Posted by snakes1100
Is this site running as a vhost acct or on a vps/dedicated server?
|
Just a standard vhost account.
I did a little digging and found this site describing the robots.txt file:
http://www.robotstxt.org/robotstxt.html
Most robots check for this file when first coming to a site and you can use the file to tell them to go away or to stay away from certain files and subfolders. I created a file and listed register.php, newthread.php, search.php, login.php, etc. Seems to be humming along now without any lag, but it has only been a couple of hours so I will keep my fingers crossed.