vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 3.8 Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=235)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=264932)

jl255 10-06-2013 05:00 AM

i suppose it shld be pretty safe to use the default list of spider list to ban on this plugin? i've no idea which to prune.....

Simon Lloyd 10-06-2013 06:12 AM

There are quite a few lists posted throughout this thread, take a look at them, if you use the built in one then
Quote:

Originally Posted by Simon Lloyd in Mod Description
Please prune out all those that you wish to be able to see your site (i suggest you definately prune out "DA" and "Custo" :


Max Taxable 10-06-2013 01:59 PM

Quote:

Originally Posted by jl255 (Post 2450315)
i suppose it shld be pretty safe to use the default list of spider list to ban on this plugin? i've no idea which to prune.....

See if the default one helps the issue you're having, first. Is my suggestion. The default list is a good list.

Wajow-community 10-11-2013 11:30 AM

Is there a mod for vb 4.x.x

Max Taxable 10-11-2013 11:36 AM

Found on the developer's profile:

https://vborg.vbsupport.ru/showthread.php?t=268208

qpurser 11-09-2013 02:58 PM

Really love this mod a lot and works great on 4.2.1

Finally Baidu is not showing up anymore in my "online users" list.

I saw another bot recently searching my forum and from some research it seems to be a bad one also: AhrefsBot http://blocklistpro.com/content-scra...o-spybots.html

I added this to my list:
Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
and
Mozilla*Ahref

Was this the correct way to do it?

Max Taxable 11-09-2013 03:51 PM

Quote:

Originally Posted by qpurser (Post 2459434)
I added this to my list:
Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
and
Mozilla*Ahref

Was this the correct way to do it?

NO!!!



Including "Mozilla" and "compatible" in this list blocks just about the entire world!

Get rid of that entry and simply put: "AhrefsBot" in instead!

qpurser 11-09-2013 05:57 PM

Quote:

Originally Posted by Max Taxable (Post 2459439)
NO!!!

Including "Mozilla" and "compatible" in this list blocks just about the entire world!
Get rid of that entry and simply put: "AhrefsBot" in instead!

Thank you for the quick reply.
I was reading post #127 and 128 and thought as long there is something behind the "mozilla" in the same line there wouldn't be an issue. My mistake I guess

Max Taxable 11-09-2013 07:10 PM

Quote:

Originally Posted by qpurser (Post 2459463)
Thank you for the quick reply.
I was reading post #127 and 128 and thought as long there is something behind the "mozilla" in the same line there wouldn't be an issue. My mistake I guess

You might be right but 1.) I wouldn't risk it, and 2.) it's not necessary.

Simon Lloyd 11-09-2013 08:31 PM

When banning whatever you add to the list will be looked for in its entirety, so if you enter "today" then it will ban:
Today
thisdayistoday
wheretodayis
one day today

if you entered "here today" then it will not ban:
one day today
thisdaytoday
today....etc

but it will ban:
we were here today
allhere todayagain....etc

When banning bots make sure you go to WOL and check out their UA as it may not contain their name in the UA.


All times are GMT. The time now is 12:10 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01411 seconds
  • Memory Usage 1,740KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (5)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (1)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete