549 spiders on my site
 

549 spiders at the same time is that a good thing or bad ?

my server load is 1.46 because of this .

Use a robots.txt file to limit the bots, i wont hazard a guess, but i would say Yahoo is visiting you today.

Typically i block all but one of the Yahoo's bot server IP's until they start following the robots.txt file you most likely didn't upload to your site.

most of then gone now. right now i have the average i always have between 10 to 30 spiders and is much better.

How did you get so many spiders? How was your robots.txt file? Do you have a mod so that you did the visits of so many spiders?

I would much all these visits from spiders in my forum. Help me.

Why would you want to restrict spiders? It's spiders that get you organic traffic.

two different spiders, two different presences on your site:

1- Googlebot: a single bot which visit each link of your site page by page
2- Yahoobot: a pyramidal bot which will call one friend per new link found on a page

Google will appear once, on a long period because it visit the site on its own... if you see multiple google bots, they usually are driven by references (too much pages to see, would be too slow if a single bot)

Yahoo bot will have so much links to visit that your sessions are overloaded like if there is really millions of visitors, but it's just a cascade of different IP used by a single engine.

i not using no hack for this .
usually i just get from 10 to 30 spiders a hour don't know what happen today .

My robots. See:

http://www.gcert.com.br/robots.txt

3 spiders. :(

Help-me Somewere??

yea..if sumone could explain the whole spider thing...lol...I know my server will make me a robot.txt file or w/e it is..but i have no idea how to use it...can anyone help? :-D