[luponero]

I wrote with Ajax a little hack to monitorize the users activity in my sites.
It checks the last 6 actions in a range of 120 seconds and update itself infos every 3 seconds.
Using this hack it is possible to show the large large amount of activity (and traffic generation) of spiders. Yahoo slurp expecially seems to be the more active. The spiders activity is very very bigger than users activity (i think in big boards too). I added a filter to exclude the spiders in the monitor and the difference is clear.

I suppose that the current spider generation is not well coded and they cause a large traffic because of repeated non logic activities.

I wrote this hack to monitorize many of my boards of different measures (mybb, invision and vb).

You can see the demo of Vb version of Site Monitor here:
http://www.mkportal.it/support