I like the idea here but I don't want all my users seeing the spiders. Have you considered an option to display this information on the admin panel only? Like and an extension of this mod.

Thanks,

Nevermind. I've combined these two mods adding the spider detection code to the admin panel one listed above. I'll mark installed regardless as all the spider detection code is from this mod.

Cheers.

How is that going to work when the code needs to be on the forumhome and Who's online?

Installed and working :up:

However it doesnt seem to be identifying this spider (I guess its a spider)
livebot-65-55-165-109.search.live.com

Thanks

VinylJunky

I had same problem with one of googlebots. It was called as a guest and in the IP info it has something like crawler-google.com or sth like this.

What can we do to prevent before something like this again?

Cheers!

Make sure you have the latest spiders xml uploaded to the includes/xml directory. Spiders are recognized by their User Agent, not their resolved IP. If you check the User Agent on those you will see they look like normal users.

I guess the spiders.xml needs updating, but I dont know the best source for accurate info.

Can anybody advise?

Thanks

VJ

You're not understanding how it works. You can't update the xml with the IP info as vb identifies spiders by their User Agent only. If the spider info is not in the UA, vb sees it as a guest, no matter what the IP resolves to.

Ah thank you, I understand now :)

So I guess that means one of three things?
- The Live Search spiders dont use/display user agent info
- The Live Search spider agent info isnt in the xml file
- It wasnt a spider

Is that a fair assumption?

Thanks

VJ

Well, I was browsing this mod when I noticed that a similar mod for VB 3.6 that I was still using is now in the graveyard. ¿Why? I don't know, but I deinstalled that one, installed this one and now I'm seeing a lot of robots I didn't see before. Baidu, Technorati, Twiceler... I'm loving this.