Yeah Simon, I had to do it, I didn't want to because it did bring in traffic but after carefully thinking about it, it's not going to hurt me or the site if I block it.

Oh the funs of owning a website eh? lol..:eek:

for me i own 2 so i am catching bots to block across 2 domains
i have spam traps on 1 to catch them

Just a bit of FYI, I was getting hit by Russian IPs and they were also trying to register, I tracked it down to "Deepnet" Explorer which I just blocked as well, just thought I would mention that here.

As for Facebook, if you've gone that route maybe it would be beneficial to set up an rss feed from your site in facebook :)

I did have the rss feed using "rss graffiti" which will no longer work now that I blocked facebook

Do you know any other way to do this ?

Ah!, no it was graffitti that i was using, however, you can get twitter to post to facebook :)

Hmmm...ok I will check to see how twitter will crawl my site lol....I did set up an RSS feed a couple minutes ago using Social RSS: http://www.facebook.com/CAGclan/app_23798139265

I will do some searching for twitter to facebook though, thanks for the suggestion!

Simon, rss graffiti still works with facebook blocked by this mod! muahaha! This is great!

:) Glad you're happy!

Yeah Simon thanks again for a great mod! Now I don't have the facebook critters and my new threads are still getting posted on facebook...muahahha!

New Spider to add you guys

SeznamBot

Seznam Fulltext Blog

I've never seen this bot before so obviously it only hangs out at the coolest sites.

It was on the list posted earlier in the thread. Nasty little bugger.

there is a new bot i spotted today

TurnitinBot/2.1

Hey guys, if you come across new bots...etc can you also post them here https://www.vbulletin.com/forum/showthread.php?t=352664 so Mosh can add them to his spider list for vbulletin too :)

Thanks, just posted mine

I had that one show up before when I used Kunena forums, I blocked that sucker about a year ago.

Thank you Simon for such a useful MOD. Simple, clean, and effective. Installed and nominated for MOTM.

Excellent mod. Has already helped reduce our guest list.

Many thanks.

The Artabus spider is still getting through even though it's on the list, anything else that can help ?

I've said this before..........go to WGO click users online (online.php), at the bottom from the dropdown choose to view user agent and check what Artabus has as its UA, it probably doesn't have artabus in the UA.

The following is what shows there Simon:

pool-109-191-73-49.is74.ru
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461)

What should I use to block it here?

to be safe block the entire string, this way you wont accidentally block legitimate users :)

Simon I feel like a fool asking this...but which one would be the entire string to use?

pool-109-191-73-49.is74.ru

or

Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461)

I don't want to block legitimate users! lol..

the second one, the first is to do with the IP address.

Thanks Simon! lol....I feel like what my Son calls me at times a "Goober"...hahah...:D

VERY few legitimate human users are going to be on MSIE 7 or older.

I block ALL MSIE except 8. Amazing how much that alone cut down on bot registration attempts.

so what do you use to block all MSIE except for 8 Max, htaccess or some other way?

heres an example

Chrome/10.*
Firefox/4.*
so i asume MSIE will work as

MSIE/6.*
MSIE/7.*

and so on

I just have it in like this:

MSIE 1
MSIE 2
MSIE 3
MSIE 4
MSIE 5
MSIE 6
MSIE 7

wont MSIE 1 block MSIE Beta 10 ?

which means MSIE 8, 9 only visitors

Nope!

This is using your mod here right?

This Mod, yeah. It ain't my mod tho.

Take a quick look at this post https://vborg.vbsupport.ru/showpost....&postcount=381 should help explain how the system works better :)

Yeep makes way more sense now, how easy it is for "us" to overlook a single post that explains it all. Sorry , I am guilty of doing so. ...

Thanks for tolerating us Lloyd, we appreciate it very much!

Its not toleration, i just love helping people :)

Hi Simon
Yours is a great product. I made the mistake of uninstalling it in order to use AbyssGuard, which is plagued with problems. I have now reinstalled Ban Spiders By User Agent. One question, are there any ramifications in banning \wbot[\/\-] with your mod? I ask as putting \wbot[\/\-] directly into my htaccess banning mecahism causes issues.
Regards / RSVP

Also.......

Does anyone know what these bots are;

Robot ID - Hits - Bandwidth - Last visit - Hits on robots.txt
robot 772 8576221 20121111093454 0
crawl 699 9556953 20121108085243 0
spider 5 114750 20121106065956 0

Bad bots using generic names?

What is there full host name