Are you admin on your site? have you tried the prune posts in admincp?

Any of you that are currently beta testing please PM me, i have fixed the emailing and it works on my test board perfectly. The emailing now includes date and time of detection, complete UserAgent string, clickable link of the thread they visted and by which spider name in your ban list they were discovered by :)

I will pm all those that pm me at around 21:00 GMT

Yes i am. Thanks for your message - i had to delete the threads via sql query haha.
Thanks & kindly regards

Glad you're sorted :)

Hi all, this next stage in the beta testing is going to be very short, i have proved it on 3 of my boards so i'm pretty confident that it does the business.

Version 3.0.0 will be released tomorrow around 8pm GMT provided there are no major issues raised by the beta testers.

I have further plans to develop this to provide some stats...etc (but don't hold your breath as i have an indepth programming project at work!) it may be some months yet :)

tested the email part over nite and it works well

Thanks ForceHSS, i'll upload that xml now then, you needn't download it as it will be the same version as you have now :)

Thanks for testing (credits given above!)

happy to help

Hi,

I have Ver. 2.0.1. running on VB 4.1.7.

What would be the best approach to upgrade from 2.0.1 to 3.0.

Thanks,

Just import the product into admincp and check the overwrite radio button :)

Sorry, I marked it.
I've the vB4 version

Good because this is the vb4 version thread ;)

Great job got rid of all my spiders. Love this, can not beat it for account security, Just a note about adding email in the notification space. I got flooded with emails of spiders being banned. it was truly amazing to see my notification risng up the screen like building blocks.

Glad you like it, there is a warning right there near the notifications about the possibility of hundreds of mails, if you are on shared hosting the chances are you are limited to 500 emails per day with a max of 500 per hour, dedicated servers usually get around 5000 per day max of 500 per hour, so using the email notification isn't the best option, in my opinion, and i only added all that notification stuff because people asked for it, the best one to use is the output file, you can prune it heavily at your leisure or just let it grow :) the only limit you then have is the amount of HDD space you have :)

what url are most of you using to redirect spiders to?

There's one included in the product but there's nothing to stop you createing a shtml for a 301 and redirecting them there, what i would say as previous is do not redirect them to Google ...etc :)

I removed that one and would rather redirect them away from my site altogether. Just wanted to know what a good one would be

Ok, in the next few days i'll release another beta where you can either enter a uel to redirect to or redirect them back to their own ip address - anyone think that would be a good idea?

Hell Yeah!

Installed and voted MOTM

I have a question, I've got a bot that's been sitting on my site for days.

It's UA is Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 2.0; and it shows in WOL as hosted-by.leaseweb.com
How can I get rid of this one other than blocking IP?

block its host

Are you talking about using this program and if so how or you talking about blocking in htaccess?

What is it's full useragent?

Not htaccess but with this mod...although i do have a similar mod that bans ip addresses:)

All I see is this,

Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 2.0; )

use this program to block his host this is what it is for

As I posted in my first post the user-agent is,

Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 2.0; )

Web host is,

hosted-by.leaseweb.com

I have tried both of these in the spider list of this program and it doesn't work. Now f there is another way using this program then please let me know.

do you have the option Ban Spiders In List = yes

The mod works fine and as it was designed to do, I just cant get rid of this one bot without blocking the IP.

The user-agent is not like the others and I cant tag it in the spider list to work correctly. Look at the UA I posted and you can see there is no bot name listed in the UA. If someone can tell me what to add to the spider list to block this bot then that's great, but if not please don't ask me if I have things ticked a certain way. This is a simple mod to use and by no means my first rodeo with mods. I'll just block the the IP range if no one can give me an answer without asking me a hundred questions.
Sorry mate, not trying to be rude but I'm looking for an answer to my question if someone knows it, not looking for questions. Thanks

This mod will do its job, simply enter the entire User Agent string in the list to ban and the mod will take care of the rest :)

If you experience further trouble i will investigate that bot further, i had a similar issue with a bot i thought i was banning, but then found the UA didn't contain the bot name, so in this instance i had to use the entire UA as i found it. Over the last few pages of this thread you will see i've posted links on how you can check UA's against your site or find UA's...etc, have a look for those links as they will help you in the fight against the bots ;)

Here's another of leaswebs UA's;
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6

So again, enter this entire UA to ban them :)

Edit: Here's a few more!
Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; Creative)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.6 (build 01425); MRSPUTNIK 1, 5, 0, 19
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) Netscape/8.0.4
Mozilla/4.76 [en] (Windows NT 5.0; U)

The above UA's are a little older but there's still a possibility of them using them, as you can see from the timings of these posts (or edits) with a little research and the help of Google you too can find the UA's that you want to ban.

Simon

Thanks for the info and this great mod. I had entered the complete UA in the spider list before posting here and that did not seem to stop it. I will enter the UA's you posted and some more I have found on Google for leaseweb. I will report back to you is this doesn't stop the bot.

Alibass

my mistake, how can i delete the threads activity from blabla

Im not with you, what do you mean?

Hi all, i have further improved this mod to allow you to automatically redirect the bot to it's own IP, if you would like to beta test for me as usual send me a pm and i'll give you download details, like every other beta test please try it with one bot at first (do also use the bots vs browsers tool to ensure redirection).

Looking forward to hearing from you :)

send will test

Thanks PM sent :)

New feature, you can now automatically redirect the spider/bot to their own IP!

Well there are a lot of happy people out there, but alas, they are all much more clever than I am.
I have downloaded the mod and it's sitting on my desktop, where do I upload it to please?
Also, what is WOL?

upload the files same place where your forums files are use a ftp program then go to your admin panel plugins and install the xml

Force there isn't any files to upload :), simply go to Admincp>Plugins & Products>Product Manage Products>import new product and thats it, if you don't have a previous version there is no need to check the overwrite radio button.

WOL = Who's On Line