List Search engine Spider at Who's online
 

I've created this hack, cause I wanted to see, when search engine spiders are browsing my forums.

This hack adds a textbox, where you can enter a list of Spider-IPs, so they would be recognized as 'Search engine spider' on who's online.

I'm using the lists from www.iplists.com right now and it seems to work without problems, though I've had to add some IPs from Inktomisearch that aren't listed there.

First I've used parts of the banip-function, but that was really slow then, so I've had to tweak it. Now its only slightly slower, than without it. You won't even recognize it.

I've ported it to the banip-function in order to reduce server-load, when using a big list of banned IPs. I'll release that, when I'm finished here.

Screenshots:
Search engine spider browsing forums
New textbox to add IPs in Admin-CP

PS: I'd be happy, if you only click install, if you really installed it, since I want to know, how many really installed it and since I need feedback.

I've added a version, that uses the useragent rather, than using an IP-List. I recommend using spiderips_useragent.txt from now on.

Search engine spider browsing forums

New textbox to add IPs in Admin-CP

[high]* Beanyhead installs :)[/high]

Nice hacks. I plan to install both of them tomorrow, as I don't have enough time right now. :(

That would be good :)

I'm running it for some days on our forums now and have occurred no problems so far, but maybe there are still bugs I haven't occured yet.

Only problem is this relies on knowing the IP's of the spiders and recognising them ;)

- miSt

e. g. with the lists from www.iplists.com? ;)

Great, I got the same idea a week ago ... and than I found it's done by you.

Hey great hack, clicked install...

but howto? just copy&paste the ip's from iplist.com to acp ?