![]() |
Thanks a lot Simon :up: ... I still have same problem with Baidu :( ... I have checked my raw access log today and still having loads of Baidu spiders in my site 48 hours after installing the mod :eek: ... this is how they appear in my log file:
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) Any recommendations? Regarding Alexa, I have certified my site and have pasted their javascript code in the header of my forum as they recommend so they can analyse my website traffic directly regardless of visitors with/without alexa toolbar ... I don't know if my alexa rank will drop due to drop in the overall visitor numbers after banning spiders? Regards |
of course your raw logs from cpanel, plesk or whathaveyou will show them visiting your site, remember this mod redirects them when trying to load your site, it does that regardless of whether they are trying to load the homepage or a thread, your Alexa shouldn't drop on account of redirecting spiders, in fact i've been redirecting these spiders for ages on one of my sites that was Page Rank 2 and it's now PR3, so if it's not hurting Google rank it has to be good :)
Can you give me a screenshot of your settings for ths mod? |
Thanks Simon, enclosed is a screenshot of my settings for the mod. My Alexa rank dropped from 83000 to 84000 but not sure if that related to the drop in the visitors count after applying the mod or just an incidental finding :confused: http://img29.imageshack.us/img29/8616/spidersq.jpg |
Midohash, if you want to pm me admin access i'll take a look.
|
Excellent mod, thank you.
What is the advantage/disadvantage to redirecting spiders back to their own IP? |
Quote:
|
to block spiders are benificial or not ?
|
Blocking spiders will save you tons on your bandwidth and server load, take the Baiduspider they send hundreds upon hindreds of bots to index your site and they don't obey robots.txt
|
working on vbulletin 4.1.10
|
The ips for baidu I also ban: 123, 124 125 and 58
|
All times are GMT. The time now is 02:16 AM. |
Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
![]() |
|
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|