vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

Simon Lloyd 09-18-2011 08:14 AM

Firstly it looks like your clients UA has been altered in the past, i have two suggestions you can try right now, firstly change DA in your list to something like DA1 and ask him to try, if that doesn't do it try altering Net Extractor to NET1 Extractor, these are the only things i can see may be a problem, if that doesn't work i'll look at it more in depth but in the mean time your user can perform a UA switch by following the instructions here http://whatsmyuseragent.com/SwitchingUserAgents.asp

Simon Lloyd 09-18-2011 03:36 PM

I've got some new for you, i tested your clients UA against my forum using your spider list and was able to gain access to my site so it's not this mod keeping him/her out.

You can check for yourself here http://www.botsvsbrowsers.com/SimulateUserAgent.asp just enter his entire useragent in the test window and your site below, hit Go and enter the Captcha that pops in to the results window, hit Go again and you'll see your site :)

So from that this mods fine and not causing a problem.

EDIT: BTW do you know that every one of the bots you supplied in that list has a space before it? the mod will look for a space before each of those words if thats how it appears in you ban spider list.

niteflyer32 09-18-2011 06:38 PM

We changed DA on the UA list and now the member can access the forum????

I'm not seeing the space before the UA in the list I posted. The list appears to be working as it has knocked many of the bots off our WOL list.

Simon Lloyd 09-18-2011 06:51 PM

Well, if it's working for you all well and good :)

At least you now have the tools to test any future queries with users having problems with access because of their UA.

Simon Lloyd 09-18-2011 07:02 PM

Hmmm seems to be a problem with page 5 of thread....this is a test post!

Edit: thread back to normal now ;)

niteflyer32 09-18-2011 07:16 PM

Thank you for your time and help. This mod rocks.

Simon Lloyd 09-18-2011 08:33 PM

Since you like it and it works for you can you mark it installed please!

niteflyer32 09-18-2011 09:18 PM

Oops, I thought I had already marked that. Done. And MOTM done too.

We have 2 other users saying they are getting blocked now. I think I may have gone overboard on blocking UAs.

Your User Agent is:
Mozilla/4.0 (compatible; MSIE 8.0; AOL 9.0; AOLBuild 4327.5204; Windows NT
5.1; Trident/4.0; GTB6.4; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR
3.0.4506.2152; .NET CLR 3.5.30729; customie8)

and

Your User Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/14.0.835.163 Safari/535.1

Also, I selected the option to have a log created and written to output.txt in the forums root but I'm not seeing that log txt file. Any idea why that log is not appearing?

Simon Lloyd 09-19-2011 06:10 AM

Thanks for that, have you used the tools (links) i gave you, you can test their useragent against your site to see f it is the mod blocking them, what you have to remember is that when you enter something like DA then the mod looks for anything that contains just that, your other members issues were sorted because you changed DA to DA1 but in their useragent was "Creative Autoupdate, when it comes to banning UA's that have just a couple of letters or such like then you are best entering either a longer string or best entering the entire useragent.

The logging and create thread i only tested on their own, that is to say i didn't have the option for banning them turned on, it seems that there is a small glitch that i'm working on, when banning the spider they are banned as your forum style is being compiled for them but the notifications are created after the forum is shown to them completely, so the spiders are taken care of well before it ever gets to the notification stage, youre not seeing notifications because there's nothing to notify.

I am working on getting them both to work together and will post here when i manage that :)

Simon Lloyd 09-19-2011 06:27 AM

Your first UA is being blocked because you have "custo" in your block list!


All times are GMT. The time now is 10:51 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01614 seconds
  • Memory Usage 1,735KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete