GavoTrav
02-18-2012, 10:45 AM
Yeah It was using a lot of resources So I installed a mod I found on here. within 10 minutes the output.txt file was filled with baidu requests.]
This is one of the requests:
02-16-2012 15:38:42 .
Matched bots[7]: . Baidu .
With User Agent: . MOZILLA/5.0 (COMPATIBLE; BAIDUSPIDER/2.0; +HTTP://WWW.BAIDU.COM/SEARCH/SPIDER.HTML) .
This is one of the requests:
02-16-2012 15:38:42 .
Matched bots[7]: . Baidu .
With User Agent: . MOZILLA/5.0 (COMPATIBLE; BAIDUSPIDER/2.0; +HTTP://WWW.BAIDU.COM/SEARCH/SPIDER.HTML) .