PDA

View Full Version : Any Way to block Baidu spider?


GavoTrav
02-18-2012, 10:45 AM
Yeah It was using a lot of resources So I installed a mod I found on here. within 10 minutes the output.txt file was filled with baidu requests.]

This is one of the requests:


02-16-2012 15:38:42 .
Matched bots[7]: . Baidu .
With User Agent: . MOZILLA/5.0 (COMPATIBLE; BAIDUSPIDER/2.0; +HTTP://WWW.BAIDU.COM/SEARCH/SPIDER.HTML) .

Videx
02-20-2012, 07:43 PM
As with any other spider you should be able to disable it with your robots.txt file. But it's a popular spider so you may only want to set a delay for it.

gsmlover4u
02-21-2012, 08:50 AM
dear use this hack
https://vborg.vbsupport.ru/showthread.php?t=264932