My full list if any need it

Add BoardReader Its a bad one.

added

# Facebook Spider
# Google Wireless Transcoder Spider

How I Can Ban Permanently From My Web Site?

Check this thread https://vborg.vbsupport.ru/showpost....&postcount=318

Installed, enabled Mod. Still can see Baidu in Who's Online - i.e, IP 180.76.5.165, 180.76.5.168, 180.76.5.66

What's wrong?

post screenshot of settings

Here are settings. With mod I have just 4-5 baidu IP's. Before I had 100 +

spiders own ip make that a yes

Installed, I hope that can help reducing the server resources usage

@Waldvb, if you have Paul M's who's online mod then you will see them in that as they actually call for a thread directly, what happens is they make that request but are instantly redirected to the plac eof your choice :)

@Winter Sonata, thanks for installing, please click "Mark As Installed" at the top left of this thread so you can recieve support if you need it :)

For me, it's stopping all but Google, Yahoo, and Bing (as I've not added those to my list).

This is an excellent mod.

Thanks Simon Lloyd , now done :) sorry forget at the 1st time :)

Best Regards!

Can't ban utel.net.ua

If that is in the USER AGENT string, sure you can. If it's the host name, this Mod doesn't "see" it. This Mod isn't for banning IPs, ISPs or hostnames.

Read this post https://vborg.vbsupport.ru/showpost....&postcount=318

How do I block these bots because I'm not understanding this mod or this whole topic...

Twitterbot,
Butterfly Topsy Crawler (2),
Embedly

If you'd like to mark it installed i'll give you all the help you need :)

Sorry, marked as installed and thanks.

Personally I wouldn't block any of these.

I wasn't sure if I should or not...

I posted a list of the ones I block, earlier in this thread. All are there for very good reason. They aren't helpful to the site, they leech too much resources, or they are typically botnet zombies. Bad actors all.

Thanks for the help Max :)

Heh. I never explained how to use your Mod....:p

I was under the impression that it was self explanatory, maybe i should add to the first post?

I got the same impression...

I must say..... This was the only thing I found to get rid of those damn Baidu spiders! I averaged 50 - 65 baidu spiders at one time. I often had almost as many guests online as I did users.

Now I am perfectly fine with 1-5 google & bing spiders online. 50+ spiders that simply don't help me? yea... No thanks!

Baidu is evil.

This mod is great! I cannot express how wonderful this mod is and how well it works. Tie that into how responsive and resourceful Simon is and it's a winner. Thanks for all the help and clarification within the comments to Simon, Max, Force, and all!

My forum is young and relatively slow as it were, but I wish to stay ahead of the game on this one and keep my security up as the server load increases. I don't see the spiders that were stopping by for a visit anymore. :)

Thanks again and keep up the good work
Marked Installed and Nominated

vB4.2.0

Glad you like it and it works well for you, i think your our first vb4.2.x so it's good to know it works upward :)

I know it's a pain but do familiarise yourself with the info that can be found at the links in the first post, these will help you as your forum gets busier, also take the time to research some of the bots, they're not all bad, some will even help your site grow.

Be mindful about who and which nations you are going to cater for before banning/allowing bots to crawl your site and you'll be golden.

Don't really know what the Yandex has done to be called bad_bot :confused: and ia_archiver ?

Nice mod installed

As has been said many times blocking spiders/bots is a personal thing, you need to understand who and which countries you are aiming your site and content at, do you have enoughj resources to allow your content to be scraped by archivers...etc, do you have enough bandwidth to allow bots who add no value or do not cater for your target audience to index your content?

Just be very honest with yourself on what your intentions are with regards to your target audience and user experience :)

here is a one to your collection Ezooms <-- really bad one don't even give a thing about robot.txt.

About the Yandex. Just in case: it's the biggest engine in Russian language. Of course if you don't wanna it index you site that is you personal thing. All I asked is: what has it done? Did anyone ever see that bot is braking the rules ?

Is your site in english?, do you cater for Russians? (Yandex = Yahoo) it's done nothing bad that i know of and my interest isn't to keep a list of "bad bots"...etc, i purely built this to save on precious bandwidth that was being decimated by bots, my site is englsh, the UTF is set up as english...etc but yandex crawl my site, i don't need them, they dont bring trafic and i don't speak Russian, so i block them, so thats what i mean, choose what you want to block with regards to who you ar targetting.

In the mod description there's links to maintained lists that you can use, the ones in the product were just your starter :)

OMG I can Banish Baudi Thank you I am sick of that worthless misbehaving IP switching overloading spider.

OK i see now. Tia. Now wondering is there is a plugin that bans counties by the name :)

We are a localized site too and have no need for Chinese or Russian search results.

Glad i could be of service ;)

xpymep.exe
here is a new one to add to the list

One you already gave us, in your fantastic list posted earlier in the thread:

https://vborg.vbsupport.ru/showpost....&postcount=321