vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   vB3 Programming Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=15)
-   -   Increase in bot visits (https://vborg.vbsupport.ru/showthread.php?t=180889)

bada_bing 05-29-2008 01:11 PM
Increase in bot visits
 
I have noticed that the past week my site went from a typical 40-80 google/yahoo bot visits at one time per day to over 1000 bot visits at one time per day, I suppose this is good but what causes such an interest all the sudden, I now continue to get growing numbers for over a week.

Jase2 05-29-2008 01:23 PM
No, you will see more Yahoo! bots. This is because if they find a problem, such as blocked content (as told by a robots.txt file) then they automatically send another bot to investigate the problem. Google only sends a few and is way more effective.

berry05 05-29-2008 02:01 PM
are bots good to have on your site?

GameWizard 05-29-2008 04:48 PM
There are different types of bots, the ones that are sent by search engines are known as 'spiders' and are GOOD, because they actually make your website available to all the search engines. Besides this, there are also "Spam Bots" which are also automated systems which register and post spam on your boards, those are to be avoided.

Jase2 05-29-2008 05:32 PM
That is correct. I just placed some htaccess rules for bad bots. Have a read of this thread: http://www.vbulletin.com/forum/showthread.php?t=252089

berry05 05-29-2008 06:03 PM
Quote:
Originally Posted by Jase2 (Post 1535390)
That is correct. I just placed some htaccess rules for bad bots. Have a read of this thread: http://www.vbulletin.com/forum/showthread.php?t=252089

wow thxs jase2!


All times are GMT. The time now is 07:02 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01065 seconds
  • Memory Usage 1,719KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (6)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 
Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 
Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete