is it possible to Limit Spiders ?
 

Hi all
I have over 400 spiders on my website for 2 weeks now and yes i like them to index my website :) is there any text that i could put in robot.txt to limit the amount that are on my website ?
I have spent too long now on google searching and not getting anywhere :(
as you can see at one point there was over 600, we are a small gaming squad been around since 2001 and have about 30-40 active members
https://vborg.vbsupport.ru/external/2011/02/2.jpg

probably htaccess but not robots.txt it allows or Denys only wont specify how many
but I cant do it i hate htaccess :)

First you need to figure out where all those guests are coming from. Chances are they aren't spiders. Check your referrers in cpanel.

How do you know some of them aren't spiders? What do they show up as in the Who's Online page?

Are you asking me? I've discussed elsewhere about our recent troubles with "Guest Attacks", where 10X the normal number of guests have been logging on and all are doing different things. They show up as Guests, and they're all from different IPs.

However, in our case it's been about two weeks since I uninstalled FeedWind and so far we haven't seen another attack (knock on wood).

Sorry for the delay, I just left them alone and they seemed to go away !!!!
and yes they do show up on who's online
I still have about 10 bots online now though but like i say i need them to index me
heres a SS of the bots online now

https://vborg.vbsupport.ru/external/2011/04/41.jpg

I wish I could say the same. It's been a couple weeks since I've reset our counter, and it's only showing Most Online at 137 right now. That's better than during the mad Guest Attacks, but still above normal for us.