Increase in bot visits

[bada_bing]

I have noticed that the past week my site went from a typical 40-80 google/yahoo bot visits at one time per day to over 1000 bot visits at one time per day, I suppose this is good but what causes such an interest all the sudden, I now continue to get growing numbers for over a week.

[Jase2]

No, you will see more Yahoo! bots. This is because if they find a problem, such as blocked content (as told by a robots.txt file) then they automatically send another bot to investigate the problem. Google only sends a few and is way more effective.

[berry05]

are bots good to have on your site?

[GameWizard]

There are different types of bots, the ones that are sent by search engines are known as 'spiders' and are GOOD, because they actually make your website available to all the search engines. Besides this, there are also "Spam Bots" which are also automated systems which register and post spam on your boards, those are to be avoided.

[Jase2]

That is correct. I just placed some htaccess rules for bad bots. Have a read of this thread: http://www.vbulletin.com/forum/showthread.php?t=252089

[berry05]

That is correct. I just placed some htaccess rules for bad bots. Have a read of this thread: http://www.vbulletin.com/forum/showthread.php?t=252089


wow thxs jase2!