PDA

View Full Version : How to get rid of China spammers


GrzegorzS
01-10-2015, 07:56 PM
Hello

Since more then one week I`m havly spammed by China here are the logs

baiduspider-123-125-71-107.crawl.baidu.com - - [10/Jan/2015:22:51:15 +0100] "GET /forum/107-Volkswagen-Caddy-Silnik-Diesel? HTTP/1.1" 200 7408 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
baiduspider-123-125-71-69.crawl.baidu.com - - [10/Jan/2015:22:51:17 +0100] "GET /forum/100-Volkswagen-Jetta-Silnik-Benzyna? HTTP/1.1" 200 7404 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
baiduspider-220-181-108-177.crawl.baidu.com - - [10/Jan/2015:22:51:32 +0100] "GET /forum/112-Volkswagen-Lupo-Silnik-Benzyna? HTTP/1.1" 200 7409 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
baiduspider-220-181-108-144.crawl.baidu.com - - [10/Jan/2015:22:51:41 +0100] "GET /forum/106-Volkswagen-Caddy-Silnik-Benzyna? HTTP/1.1" 200 7406 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
baiduspider-123-125-71-43.crawl.baidu.com - - [10/Jan/2015:22:51:48 +0100] "GET /online.php? HTTP/1.1" 200 7379 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"

I`m getting 500 UQ visits/per day- I tried to use following robots.txt

User-agent: Baiduspider
Disallow: /

and .htaccess

#RewriteBase /
Order deny,allow
deny from *.baidu.com
RewriteCond %{HTTP_USER_AGENT} ^Baiduspider.* [NC]

But that didn`t work - Can you help me to get rid of it ?

Thanks
Grzegorz

ozzy47
01-10-2015, 07:59 PM
Use this mod, Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

GrzegorzS
01-15-2015, 09:14 AM
Thanks I used that mod and indeed I don`t see anymore china in google analitics.

But I can still entries in access_log - it`s accessing site like previously

is that consuming server resources ?

I noticed that file output.txt not growing despite options are enabled.
Please advice

Cheers
Greg

ozzy47
01-15-2015, 09:52 AM
Well you would need to ban them at server level with a firewall it stop them from even trying to assess at all.

You need to ask in the mods thread about the log file. :)