My board is under attack

[TLCanna]

There has been some sort of web crawler or web bot that has been going through my board for the last week. It's logged in as a guest. It attempts to try every function on the board and it's IP always begines with 66.196.72.*

Here is how I have tried to get rid of it, but nothing has worked.

1.) I tried to do a partial ban thru control panel.

2.) I added some code to redirect it:

if (substr($REMOTE_ADDR, 0, 9) == "66.196.75"){
header("Location: http://www.google.com/");
exit;
}


Nothing will phase it. Help me please!

[assassingod]

It's either a bot, or you are getting a DoS attack (Which has happened to a view boards recently)

[ImportPassion]

it's the inktomi spider.
you don't want your pages indexed?

you could put something like this in the htaccess in the root

RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} ^inktomi.* [NC]
RewriteRule .* http://www.google.com/ [L,R]

you will need to find out what
RewriteCond %{HTTP_USER_AGENT} ^inktomi.* [NC]
should be tho.

[filburt1]

It's Inktomi, which I quite well recognize by now. I bet you $100 that it's still on my forums.

Don't ban it. You'd be out of your mind to do so.

[Erwin]

Inktomi powers a lot of search engines out there, so be thankful the spider is spidering your forums.

[PixelFx]

inktomi spider <-- hit one of my sites a few weeks ago, I had over 56 bots scanning everything, it was a bit scary, I found a script that shows the ip / name of bots scanning sites, so you know who is who, It was on teckwizard, although that site is down now, I'll see if i can clean up the code and post it.

inktomi spider has about 900 veriations of it's self in multiple languages... it usually lasts a few days at the beginning of a month then calms down. Just make sure you setup robots.txt in your site root, that disallows it from scanning private sections of your site and you should be ok

[Dean C]

I didn't know that's what robots.txt did ?

[obiwan8472]

I had that about a month ago! 56 guests at one point! woohooo! Bots love me.

[texastodd]

Had the same problem...they don't conform to the robots.txt

do this...

1. open the header_include template

2. put this in it...

<META NAME="ROBOTS" CONTENT="NOINDEX">

3. Sit back and watch them drop like flies

[Gary King]

Don't know why you'd want to stop them though.