![]() |
Don't really know what the Yandex has done to be called bad_bot :confused: and ia_archiver ?
Nice mod installed |
As has been said many times blocking spiders/bots is a personal thing, you need to understand who and which countries you are aiming your site and content at, do you have enoughj resources to allow your content to be scraped by archivers...etc, do you have enough bandwidth to allow bots who add no value or do not cater for your target audience to index your content?
Just be very honest with yourself on what your intentions are with regards to your target audience and user experience :) |
here is a one to your collection Ezooms <-- really bad one don't even give a thing about robot.txt.
About the Yandex. Just in case: it's the biggest engine in Russian language. Of course if you don't wanna it index you site that is you personal thing. All I asked is: what has it done? Did anyone ever see that bot is braking the rules ? |
Is your site in english?, do you cater for Russians? (Yandex = Yahoo) it's done nothing bad that i know of and my interest isn't to keep a list of "bad bots"...etc, i purely built this to save on precious bandwidth that was being decimated by bots, my site is englsh, the UTF is set up as english...etc but yandex crawl my site, i don't need them, they dont bring trafic and i don't speak Russian, so i block them, so thats what i mean, choose what you want to block with regards to who you ar targetting.
In the mod description there's links to maintained lists that you can use, the ones in the product were just your starter :) |
OMG I can Banish Baudi Thank you I am sick of that worthless misbehaving IP switching overloading spider.
|
OK i see now. Tia. Now wondering is there is a plugin that bans counties by the name :)
|
We are a localized site too and have no need for Chinese or Russian search results.
|
Quote:
|
xpymep.exe
here is a new one to add to the list |
Quote:
https://vborg.vbsupport.ru/showpost....&postcount=321 |
All times are GMT. The time now is 05:25 PM. |
Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information | |
---|---|
|
|
![]() |
|
Template Usage:
Phrase Groups Available:
|
Included Files:
Hooks Called:
|