vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=264932)

Lee G 09-18-2011 03:50 PM

I tried three variants and made sure I wernt going to be locked out the forums. Never do anything without a get out of trouble method :D

First off was two versions of xp
Windows*XP
Windows\XP

Tried viewing over at bots vrs browsers with a simple user agent of Windows XP
When neither of those two worked, I made sure I had another browser fired up, just in case I blocked myself and any browser with any mention of windows in the user agent
And tried plain old Windows XP

Worked a treat. Same as blocking Windows 95, Windows 98, Windows ME and MSIE 5
No need for any extra variables :up:

Simon Lloyd 09-18-2011 03:53 PM

Quote:

Originally Posted by Lee G (Post 2247537)
...In your file you have SOSO from China, they have now changed their user agent to jikespider

I think you'll find they are still using SOSO too as right now i have 6 of them trying to access my site :)

Simon Lloyd 09-18-2011 03:57 PM

Lee, you're a star :), i just checked the UA from the vb4 version issue and it's not this mod keeping their client out of the forum, until you nudged me i'd completely forgot about bots v browsers even though i have quoted it many times here at vb.org in the past!

Lee G 09-18-2011 04:19 PM

Im just good at breaking things, ask any software developer or skin seller that I use :D

Another one to consider adding to the block list is UnwindFetchor/1.0
They are another scrape for gain outfit, by the looks of it

Lee G 09-18-2011 06:01 PM

Another one thats good for monitoring or just plain banning is this
;)
I checked it works as is. Its a give away to a messed about with user agent

Google JP must be getting busy :D

Simon Lloyd 09-18-2011 06:20 PM

Hi Lee, did you mean the wink?

Lee G 09-18-2011 07:00 PM

Should have wrapped it in php tags :D
PHP Code:

;) 

This is one example of one use agent thats been modified
PHP Code:

Mozilla/4.0 (compatible;) 

Use the tracking system and see how many user agents use it.
They think by taking out some information, you wont catch on and ban them :D

One use agent that had a bad habit of trying to inject base64 when I used the other blocking system was this one
libwww-perl

Another that only ever hits from ips on honeypot is this
w3m/

The good thing about this mod, you can track and then decide if its worth banning
Older user agents are worth watching as well. Firefox is an easy one to watch.
Firefox gives you the date the version came out

This example
PHP Code:

Mozilla/5.0 (WindowsUWindows NT 6.1en-USrv:1.9.2.22Gecko/20110902 Firefox/3.6.22 

If you look at the Geko/ part. It gives the date the version of firefox was released
I ban Firefox/1 and Firefox/2

Opera dont have many use it. I personally love the browser, but its another browser that auto updates. You can catch a lot of low life that way
Present version of Opera is Version/11.51

Simon Lloyd 10-22-2011 11:19 PM

Hi Guys, just to let you know there is a brand new product uploaded with everything fixed :)

Simon Lloyd 10-31-2011 07:24 AM

New product uploaded now with automatic redirect to spiders/bots own ip :)

gigawiz 11-05-2011 12:46 PM

marked as installed

I uninstalled the vb4 version and installed this one as per the instruction earlier on in the thread. This mod really is just epic and no vb forum should be without it.

EDIT - I have disabled the mod from creating new threads but it is still doing it, I have removed all the user info from the settings (user ID and forum ID) and it still posts threads which do not exist! Please help before I go totally round the bend :(

Thank you in advance.

gigawiz.


All times are GMT. The time now is 02:14 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01129 seconds
  • Memory Usage 1,740KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (3)bbcode_php_printable
  • (1)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete