inktomi spider <-- hit one of my sites a few weeks ago, I had over 56 bots scanning everything, it was a bit scary, I found a script that shows the ip / name of bots scanning sites, so you know who is who, It was on teckwizard, although that site is down now, I'll see if i can clean up the code and post it.
inktomi spider has about 900 veriations of it's self in multiple languages... it usually lasts a few days at the beginning of a month then calms down. Just make sure you setup robots.txt in your site root, that disallows it from scanning private sections of your site and you should be ok
08-09-2003, 06:26 AM
Hybrid Mode
