my site got bandwidth limit exceeded in Junly with 10GB bandwidth, now we have 50GB bandwidth, sometimes google spiders come over 200 spiders at a time. I ought to use the robots.txt file to prevent them not going to link that useless for searching and they can't access (like new thread or new reply). alos I use .htaccess file to prevent hot linking from other sites.
BTW: is there a way to prevent any file we want ? like .mp3, .wma,... files, I have a jukebox but I don't want other sites use my music files.
|
09-11-2004, 01:49 AM
Hybrid Mode
