vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

lazytown 03-19-2014 10:19 PM

Does this have an option to just block registrations?

ozzy47 03-19-2014 11:24 PM

No, blocking the bot, in affect stops them from your site all together, which is what you want to do with bad bots. :)

Simon Lloyd 03-20-2014 06:29 AM

When you've blocked a useragent they offender cannot even load a page on your site, so they cannot register or do anything.

ggrimes620 03-20-2014 08:48 PM

I used to see upwards of about 100-200 bots/guests on my board at all times of the day. I installed Simon's MOD last week and it has practically eliminated all the bad bots from seeing my website! I only see legit bots/guests viewing my website now!

Very happy with this MOD!

Simon Lloyd 03-20-2014 09:15 PM

Nice to hear its doing its job as well ad expected :-)

ozzy47 03-26-2014 02:03 AM

Ok I got a question, every once in awhile, I notice bots that are in the list, showing up in WOL, it is not often, but it does happen.

Code:

180.76.5.24 - Whois
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Code:

199.21.99.109 - Whois
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

Is it possible that at the exact moment those spiders are hitting that a cron is running, and allowing the bots to bypass the check?

Simon Lloyd 03-26-2014 02:18 AM

The bots aren't bypassing the check and the mod is live, it doesn't use cron, the mod runs at every page call. You'll see them now and then as they do actually have to make a call for a page of some sort in order to be checked then redirected, it may be at this moment of redirection that they get on the WOL list, but as you are aware the list isn't live and is subject to the timeout period you set in admincp (mines set for 900 seconds), one other reason you could see them is if you use a mod for who visited ...etc like Paul M's one, they will always show there as his mod is doing it's job recording them but mine is equally doing it's job by transporting them anwhere but they're intended page :)

ozzy47 03-26-2014 02:26 AM

I know they show in his mod, but it is just strange seeing them show up in online.php page.

I remember back in 2011 when I beta tested this for you, that never happened. :confused:

Max Taxable 03-26-2014 03:14 AM

Quote:

Originally Posted by Simon Lloyd (Post 2489567)
The bots aren't bypassing the check and the mod is live, it doesn't use cron, the mod runs at every page call. You'll see them now and then as they do actually have to make a call for a page of some sort in order to be checked then redirected, it may be at this moment of redirection that they get on the WOL list, but as you are aware the list isn't live and is subject to the timeout period you set in admincp (mines set for 900 seconds), one other reason you could see them is if you use a mod for who visited ...etc like Paul M's one, they will always show there as his mod is doing it's job recording them but mine is equally doing it's job by transporting them anwhere but they're intended page :)

I use that Mod on two boards and never, ever saw a spider on this list, appear there. I have also never seen a spider on this list, showing up in WoL.

I am on vB3.8 though..... And they do not and never have shown up in Paul's Mod.

ozzy47 03-26-2014 11:42 PM

Strange, they have always showed in Paul's mod for me. Which is fine, I just don't get the WOL deal.

Visitors (359),
Logged In (6),
Google Spiders (51),
Majestics MJ12bot Spiders (12),
Bing Spiders (12),
Whois Source Spiders (1),
Baidu Spiders (111),
A Bot Spiders (1),
Wayback Machine Spiders (15),
Squider Spiders (29),
AhrefsBot Spiders (6),
BLEXBot Spiders (1),
Exabot Spiders (1),
Galaxy Spiders (1),
Xenu Link Sleuth Spiders (2),
AboutUs:Bot Spiders (1),
MSNBot Spiders (1),
EasouSpider Spiders (3),
Alexa Archive Spiders (1),
Sucuri Spiders (5),
Ezooms Spiders (2),
Indy Library Spiders (1),
Wget Spiders (1),
Google Favicon Spiders (1),
Nutch Spiders (1),
Crawler4j Spiders (1),
Alexa Bot Spiders (3),
Yahoo! Slurp Spiders (1)


All times are GMT. The time now is 03:29 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01927 seconds
  • Memory Usage 1,741KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (1)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (3)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete