vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

ForceHSS 10-29-2012 03:25 AM

you right did not see that bit late hear could be the reason :)

Disco_Dave 10-31-2012 03:05 PM

I installed this mod yesterday and from then I have been bombarded with this spider AhrefsBot Spider I've tried adding them to this mod, but no joy.

Max Taxable 10-31-2012 05:17 PM

Quote:

Originally Posted by tricksodave (Post 2377295)
I installed this mod yesterday and from then I have been bombarded with this spider AhrefsBot Spider I've tried adding them to this mod, but no joy.

It blocks that spider, how did you add it?

TheSupportForum 10-31-2012 05:27 PM

Quote:

Originally Posted by tricksodave (Post 2377295)
I installed this mod yesterday and from then I have been bombarded with this spider AhrefsBot Spider I've tried adding them to this mod, but no joy.

you need to block their IP, AhrefsBot has more than 1 IP

Max Taxable 10-31-2012 05:29 PM

Quote:

Originally Posted by simonhind (Post 2377329)
you need to block their IP, AhrefsBot has more than 1 IP

The whole purpose of this Mod is to block user agents, so you don't have to block IP addresses.

If the person put "AhrefsBot" in this Mod, it should be blocked no matter the IP.

Simon Lloyd 10-31-2012 09:06 PM

I think you'll find that if you check WOL when arhefsbot is online and then choose to show useragent from the dropdown ahrefsbot isn't actually in their useragent, i think i posted about this to another user a few posts or so ago.

TheSupportForum 10-31-2012 09:20 PM

why not just put

*

/

it blocks all useragents and will only require standard 1 line box
this is what i have done

Simon Lloyd 10-31-2012 09:37 PM

Quote:

Originally Posted by simonhind (Post 2377371)
why not just put

*

/

it blocks all useragents and will only require standard 1 line box
this is what i have done

that will block everyone if using it in my mod!

Here's some UA's that ahrefs use
Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/3.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/),gzip(gfe)
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/),gzip(...(gfe),gzip(gfe)

So use SiteBot or Ahrefs as the banning UA's :)

TheSupportForum 10-31-2012 10:31 PM

for those who want to block blocks accesses through Facebook external hit

facebookexternalhit/1.0

Max Taxable 10-31-2012 11:44 PM

Quote:

Originally Posted by Simon Lloyd (Post 2377369)
I think you'll find that if you check WOL when arhefsbot is online and then choose to show useragent from the dropdown ahrefsbot isn't actually in their useragent, i think i posted about this to another user a few posts or so ago.

I have had no problems, Ahrefsbot is in my collection, and I never see it hit my site anymore.

Pretty sure the OP is saying he sees "ahrefsbot" in his WOL after adding it to your mod.


All times are GMT. The time now is 08:36 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01836 seconds
  • Memory Usage 1,740KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (5)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete