Quote:
Originally Posted by setishock
I looked just a couple of minutes ago and you have 79 of those Baidu bots walking all over your forum. You do know they burn up your bandwidth? Once they get settled in they will stay there eating bandwidth until you put your foot in their tails and boot them out the door. If you're running cpanel go in to the IP blocker and enter Baidu then save it. Any critter with Baidu in the user agent string will not be able to get in your forum let alone "see" it. Ain't 404 errors wonderful?
|
What setishock says here is very important. Baidu is the most aggressive and useless bot out there. It does a forum no good at all to have them - what, do we think people in China are going to be searching us up? They do not obey robots.txt at all and they are essentially leeches. Blocking them is a must.