The Arcive of Official vBulletin Modifications Site.It is not a VB3 engine, just a parsed copy! |
|
|
|||||||
Ban Spiders by User Agent Details »»
|
|||||||||||||||||||||||||||
What this mod does
With this mod you can enter User Agents to watch or ban, you can also recieve emails or have an Output.txt created and updated with time and date of visits. It doesn't just have to be spiders, you can watch, log or ban any useragent! How to install Simply import the product ban_spider, the mod is active by default but none of the other options are turned on. What is a UserAgent? http://en.wikipedia.org/wiki/User_agent Understanding a UserAgent string http://user-agent-string.info/parse Genuine User Getting Blocked? https://vborg.vbsupport.ru/showpost....&postcount=105 Tools to help http://whatsmyuseragent.com/SwitchingUserAgents.asp http://www.botsvsbrowsers.com/SimulateUserAgent.asp FAQ https://vborg.vbsupport.ru/showpost....&postcount=137 How does it work? https://vborg.vbsupport.ru/showpost....&postcount=381 What's a bot? http://en.wikipedia.org/wiki/Spambot How do i ban a bot? https://vborg.vbsupport.ru/showpost....&postcount=318 https://vborg.vbsupport.ru/showpost....7&postcount=51 Where's output.txt located? https://vborg.vbsupport.ru/showpost....&postcount=216 Bad bot lists https://vborg.vbsupport.ru/showpost....&postcount=259 https://vborg.vbsupport.ru/showpost....&postcount=224 https://vborg.vbsupport.ru/showpost....&postcount=281 Tested on vb3.7.x, vB3.8.x , vB4.x.x but should work on any version. __________________________________________________ __________________ Special thanks to: Lior KH99 BoP5 for helping me sort out a few issues ...and beta testers ForceHSS (Special thanks to Force for latest testing) ozzy47 GreyHost If you use this please mark as INSTALLED History 9th June 2011 Orginal xml added 12th June 2011 Added both email notification and text file logging 22nd June 2011 Version 2.0.0, Added create thread on activity
08th October Beta testing started for thread creation. 20th October Beta testing started for emailing. 21st October Beta testing complete Ver 3.0.0 uploaded 29th October minor fix added to cope with empty userid on thread creation 30th October Beta testing automatic redirection to spiders/bots IP 31st October New xml uploaded with automatic redirect to IP 25th November Minor fix for blank forumid fixed 26th November 2011 Fixed version check & create thread Off by default 17th December 2014 Version 3.1.0 uploaded, Hook changed extra logging and statistics added by Ozzy47 (Chris) 18th December 2014 Version 3.1.1 uploaded, prevented spiders being counted when mod turned off. 17th December 2014 Version 3.1.2 uploaded, due to rogue code from another mod The Bad Bots list is now included in the product  Please prune out all those that you wish to be able to see your site (i suggest you definately prune out "DA" and "Custo" : Support will now only be given to those who have this mod marked as INSTALLED Download Now
Supporters / CoAuthors Show Your Support
|
|||||||||||||||||||||||||||
About Developer
Visit Web Site
Uses Plugins 
No support by the author.
| 16 благодарности(ей) от: | ||
| ASCONAN, BlueCheri, Disco_Dave, ForceHSS, Gn_Snake, GreyGhost, htscpl, Michael.A, midnz, obglobal.net, puertoblack2003, RichieBoy67, rootsxrocks, tanzeelniazi, too_cool_3, victorvu | ||
| Comments |
|
#523
11-09-2013, 08:25 PM
|
||||
|
||||
Hi Toxic2, banning UAs is a personal thing, you have to choose which to ban or not, throughout this thread (and the other vb versions of this mod) there are lists, there's a maintained list of spiders a vb.com in a thread by Mosh so pretty much all of the crawlers will be listed there (a download from his site) and you just choose which you want to ban by unveiling their UA when they visit your site.
|
| Благодарность от: | ||
| Toxic2 | ||
|
#524
11-09-2013, 09:55 PM
|
||||
|
||||
|
This Mod's default list is a pretty dog gone good list, but like Simon says it might not meet your needs. It depends on your target audience countries, your preferences, all that.
|
| Благодарность от: | ||
| Simon Lloyd | ||
|
#525
11-09-2013, 10:09 PM
|
||||
|
||||
|
Quote:
As was mentioned above it is a personal choice on what you block. There are thousands of sites out there that don't block any and are doing just fine. You need to figure out what's important for your site. Being hit hundreds of times a day from bots from regions of the world you probably don't even cater too like China or countries of the former Soviet Union? or Blocking those bots and in turn reducing server load and load times for those users you do want to cater too? For instance if you block IE6 (MSIE6) you will currently block over 20% of Chinese internet users (average everywhere else in the World is less than 1% using IE6). When you consider China has 1.3 billion people that is a lot of potential website traffic. At the same time China also accounted for nearly 40% of the world's computer hacking attack traffic during 2012. If you have content that is viable for Chinese users which can possibly turn into potential profit (sales / ad clicks) for you then blocking MSIE6 and chinese specific bots like baiduspider, iaskspider, sogou spider, Sosospider, YoudaoBot and others is probably not recommended. There are plenty of good resources of information in this thread and other places on the net on useragents. Just remember copying someones elses useragent blocking list directly and not specifically taking a little time and tweaking it for your own needs is almost guaranteed to negatively impact your site traffic. Here are a couple of additional resources: http://www.useragentstring.com/pages/Crawlerlist/ http://www.user-agents.org/
|
| 3 благодарности(ей) от: | ||
| Max Taxable, Simon Lloyd, Toxic2 | ||
|
#526
11-09-2013, 10:18 PM
|
||||
|
||||
|
Quote:
|
| Благодарность от: | ||
| Toxic2 | ||
|
#527
11-10-2013, 07:29 PM
|
||||
|
||||
|
If you really want to block MSIE1 then enter it exactly as that plus a leading space, if I remember rightly I've allowed it to accept spaces rather than ignore them, so doing it like that will not (or shouldn't) ban MSIE10.
|
|
#528
11-10-2013, 10:04 PM
|
||||
|
||||
|
I have similar problem, it might be solved now.
But anyway, just to ask it, what other than blocking MSIE 1 could block legitimate users in this list? If anyone knows: Quote:
|
|
#529
11-10-2013, 10:27 PM
|
||||
|
||||
|
Quote:
|
|
#530
11-11-2013, 11:40 PM
|
||||
|
||||
|
Actually, if you use string "MSIE 1" it blocks users of MSIE 10 and 11, as product looks for string anywhere, not as a whole word. And, if I'm not mistaken, to block only MSIE 1, you should use string MSIE 1,0.
I had many regular users who couldn't reach my site, probably all of them use MSIE 10 or 11.
|
|
#531
11-12-2013, 12:11 AM
|
||||
|
||||
|
Quote:
But I agree with you, there's really no reason to have IE1 on the ban list, there very likely isn't a functioning computer anywhere that is also online, that runs it. IE6 is the biggest botnet zombie browser though, and there are MILLIONS of them still online.
|
 |
«
Previous Thread
|
Next Thread
»
| Thread Tools | |
|
|
All times are GMT. The time now is 07:54 PM.