vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vBulletin 4.x Add-ons (https://vborg.vbsupport.ru/forumdisplay.php?f=245)
-   -   Miscellaneous Hacks - Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=268208)

zascok 08-15-2012 03:18 PM

Don't really know what the Yandex has done to be called bad_bot :confused: and ia_archiver ?

Nice mod installed

Simon Lloyd 08-15-2012 05:09 PM

As has been said many times blocking spiders/bots is a personal thing, you need to understand who and which countries you are aiming your site and content at, do you have enoughj resources to allow your content to be scraped by archivers...etc, do you have enough bandwidth to allow bots who add no value or do not cater for your target audience to index your content?

Just be very honest with yourself on what your intentions are with regards to your target audience and user experience :)

zascok 08-15-2012 06:40 PM

here is a one to your collection Ezooms <-- really bad one don't even give a thing about robot.txt.

About the Yandex. Just in case: it's the biggest engine in Russian language. Of course if you don't wanna it index you site that is you personal thing. All I asked is: what has it done? Did anyone ever see that bot is braking the rules ?

Simon Lloyd 08-15-2012 07:10 PM

Is your site in english?, do you cater for Russians? (Yandex = Yahoo) it's done nothing bad that i know of and my interest isn't to keep a list of "bad bots"...etc, i purely built this to save on precious bandwidth that was being decimated by bots, my site is englsh, the UTF is set up as english...etc but yandex crawl my site, i don't need them, they dont bring trafic and i don't speak Russian, so i block them, so thats what i mean, choose what you want to block with regards to who you ar targetting.

In the mod description there's links to maintained lists that you can use, the ones in the product were just your starter :)

rootsxrocks 08-15-2012 07:22 PM

OMG I can Banish Baudi Thank you I am sick of that worthless misbehaving IP switching overloading spider.

zascok 08-15-2012 07:28 PM

OK i see now. Tia. Now wondering is there is a plugin that bans counties by the name :)

rootsxrocks 08-15-2012 07:34 PM

We are a localized site too and have no need for Chinese or Russian search results.

Simon Lloyd 08-15-2012 08:55 PM

Quote:

Originally Posted by rootsxrocks (Post 2357223)
OMG I can Banish Baudi Thank you I am sick of that worthless misbehaving IP switching overloading spider.

Glad i could be of service ;)

ForceHSS 10-29-2012 03:03 AM

xpymep.exe
here is a new one to add to the list

Max Taxable 10-29-2012 03:10 AM

Quote:

Originally Posted by ForceHSS (Post 2376738)
xpymep.exe
here is a new one to add to the list

One you already gave us, in your fantastic list posted earlier in the thread:

https://vborg.vbsupport.ru/showpost....&postcount=321


All times are GMT. The time now is 05:25 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01785 seconds
  • Memory Usage 1,742KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (4)pagenav_pagelink
  • (2)pagenav_pagelinkrel
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (10)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete