vb.org Archive - View Single Post - Miscellaneous Hacks - vB Global Translator - Multiply your indexed pages & put search traffic on autopilot

CThiessen · #**420** 07-16-2009, 07:40 AM

Quote:

Originally Posted by imported_silkroad

So, there is no mass "translation" at all, if you have no bots clicking on the translations flags; and even if you have GoogleBot pulling on your site at all times, like we do, with 20 to 50 bots pulling at any time, the bots do not only pull on the translations flags, they are pulling all your content, so don't worry, this mod will not crash your site.

Cheers.

Hi,
well not this script will crash your server.
But you should have ever an eye on your Server load and memory.
This script needs some of that. My Server crashed after I put this script on.
So I am try to optimise my server settings without any success.

The reason (I hope) was the crawler form www brandwatch net
They didi not respect the robos.txt at all:

Code:

User-agent: magpie-crawler
  Disallow: /

Dose not help.

They try to crawl my site with a speed 50 times higher than Google.
All ?normal? Search Engines donning their Job with more respect.

I goning to move server anyway but is planed for November this Year.
My current one has only 1G of memory.
So: additional needs + to high crawler activities + low memory = crash

But it?s not this script, it was the crawler. Now he find himself in the IP-Tables as ?Drop?

This AddOn is working very well.

Christian

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01233 seconds Memory Usage 1,766KB Queries Executed 11 (?)
More Information
Template Usage: (1)SHOWTHREAD_SHOWPOST (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (1)bbcode_code (1)bbcode_quote (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)post_thanks_box (1)post_thanks_button (1)post_thanks_javascript (1)post_thanks_navbar_search (1)post_thanks_postbit_info (1)postbit (1)postbit_onlinestatus (1)postbit_wrapper (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit reputationlevel showthread	Included Files: ./showpost.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/functions_bigthree.php ./includes/class_postbit.php ./includes/class_bbcode.php ./includes/functions_reputation.php ./includes/functions_post_thanks.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_postinfo_query fetch_postinfo fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete showpost_start bbcode_fetch_tags bbcode_create postbit_factory showpost_post postbit_display_start post_thanks_function_post_thanks_off_start post_thanks_function_post_thanks_off_end post_thanks_function_fetch_thanks_start post_thanks_function_fetch_thanks_end post_thanks_function_thanked_already_start post_thanks_function_thanked_already_end fetch_musername postbit_imicons bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete postbit_display_complete post_thanks_function_can_thank_this_post_start showpost_complete
Messages: