Hi all i posted this at vb.com in response to someone but thought it should also be found here
Quote:
|
Originally Posted by Simon Lloyd @ vB.com
Just thought i should post this for all those that don't want to add a mod to do it for you:
if you have mod_write on your apache enabled, add this to your .HTACCESS :
HTML Code:
RewriteEngine On RewriteCond %{HTTP_USER_AGENT} ^baiduspider [NC] RewriteRule .* - [F]
or add this to your httpd.conf
HTML Code:
SetEnvIfNoCase User-Agent "^Baidu" bad_bot
<Directory />
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Directory>
|
10-01-2011, 03:18 PM
Banning bots that don't follow robots.txt WITHOUT a mod!
Hybrid Mode
