Go Back   vb.org Archive > Community Discussions > Forum and Server Management
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 10-05-2011, 01:46 AM
Contra Fates's Avatar
Contra Fates Contra Fates is offline
 
Join Date: Sep 2008
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Emergency Server Load Reduction.

I'm an Admin of a big board with close to 5 million posts, and about 1400 members online a day. The forum is hosted on a VPS that was able to fit our needs until recently, and while we are making the shift to a dedicated server, it won't get done for another week, and I'm looking for quick things I can do through the Admin CP that may alleviate the server load. Like clockwork during peak hours, the server's load is anywhere from 10-19, and is unusable during those times.

We disabled VBSEO to try and alleviate server load, followed the instructions on multiple 'how to reduce server load' threads, and use VB Optimise, but it's only helped things temporarily.

We've recently disabled the ability for guests to view the forum, and will also be temporarily closing a few of the non vital forums on the board.

Any proven suggestions to temporarily alleviate our server issues until we can make the switch will be greatly appreciated.
Reply With Quote
  #2  
Old 10-05-2011, 07:26 AM
Marco64Th Marco64Th is offline
 
Join Date: Aug 2011
Posts: 34
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Maybe a bit drastic but it sometimes did wonders for me when a server was under attack, is to place a .htaccess login on the main directory. You can simply list the user/pass in the login prompt, but that will remove all bots and other unwanted visitors.

Also disable any hotlinking and/or RSS feeds.
Reply With Quote
  #3  
Old 10-05-2011, 07:49 AM
Mooff Mooff is offline
 
Join Date: Mar 2010
Posts: 301
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Really drastic way:
Use a very lightweight mobile style which doesn't show avatars, signatures and almost all images as the default style for all users.
(we used a 58k style when we had our spam-friday, a day where we removed the posting limitations for 10minutes and encouraged our users to give it a shot, once we grew bigger it crashed our server everytime, so we had to stop doing that )
Anyway for vb4:
https://vborg.vbsupport.ru/showthread.php?t=249277
Idea is to reduce the http requests (pictures and javascript) and send less data, so even under massive server load the forum would still manage to load in a reasonable time.

Another way to reduce http requests is our sprites addon:
https://vborg.vbsupport.ru/showthread.php?t=266696


Cheers
Reply With Quote
  #4  
Old 10-05-2011, 04:56 PM
Contra Fates's Avatar
Contra Fates Contra Fates is offline
 
Join Date: Sep 2008
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Marco64Th View Post
Maybe a bit drastic but it sometimes did wonders for me when a server was under attack, is to place a .htaccess login on the main directory. You can simply list the user/pass in the login prompt, but that will remove all bots and other unwanted visitors.

Also disable any hotlinking and/or RSS feeds.
I can't do the first suggestion, because I only have access to the ACP, no direct root access. I'll look into the other ideas, though.

Quote:
Originally Posted by Mooff View Post
Really drastic way:
Use a very lightweight mobile style which doesn't show avatars, signatures and almost all images as the default style for all users.
(we used a 58k style when we had our spam-friday, a day where we removed the posting limitations for 10minutes and encouraged our users to give it a shot, once we grew bigger it crashed our server everytime, so we had to stop doing that )
Anyway for vb4:
https://vborg.vbsupport.ru/showthread.php?t=249277
Idea is to reduce the http requests (pictures and javascript) and send less data, so even under massive server load the forum would still manage to load in a reasonable time.

Another way to reduce http requests is our sprites addon:
https://vborg.vbsupport.ru/showthread.php?t=266696


Cheers
Oh my, that would be a bit drastic. I don't have VB4, though, I'm using VB3.8. =/

Any other ideas that would be for VB3, and able to be done through just the Admin CP would be greatly appreciated.
Reply With Quote
  #5  
Old 10-06-2011, 08:15 AM
souperman souperman is offline
 
Join Date: Mar 2011
Posts: 131
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

why would you put that big of a forum on a vps?

Anyways, disable who is online, birthdays, and lower the forumdisplay results.

Also, changing the skin won't help much...the real issue is the queries being perform. Though you can also use nginix if you are truly have a lot of http requests.
Reply With Quote
  #6  
Old 10-06-2011, 09:56 AM
Mooff Mooff is offline
 
Join Date: Mar 2010
Posts: 301
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

The real issue is his server beeing to small for the board - which he does know.

And yes an apache can be really demanding and nginx is the far better choice, but nginx isn't an option if he doesn't has root access and is going to move in a week anyway.

Options in the acp - you could disable the search function i guess.
Reply With Quote
  #7  
Old 10-06-2011, 03:38 PM
Contra Fates's Avatar
Contra Fates Contra Fates is offline
 
Join Date: Sep 2008
Posts: 40
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by souperman View Post
why would you put that big of a forum on a vps?

Anyways, disable who is online, birthdays, and lower the forumdisplay results.

Also, changing the skin won't help much...the real issue is the queries being perform. Though you can also use nginix if you are truly have a lot of http requests.
Not my doing for the VPS, I'm not the one in charge, just helping out as Admin. Though, it was handling the database just fine up until the last month or so, we'd keep getting hang ups and the server load could sky rocket, and it'd be brought down to its knees during the daily backups.

I'll disable the Who is Online bit, but the other suggestions are done already.

Quote:
Originally Posted by Mooff View Post
The real issue is his server beeing to small for the board - which he does know.

And yes an apache can be really demanding and nginx is the far better choice, but nginx isn't an option if he doesn't has root access and is going to move in a week anyway.

Options in the acp - you could disable the search function i guess.
I'll look into selectively disabling the search function, perhaps removing it from some of the more active forums.

Also, while it doesn't make a difference, I'm female, haha. Thanks for the suggestions. =)
Reply With Quote
  #8  
Old 10-07-2011, 04:00 AM
CarlitoBrigante's Avatar
CarlitoBrigante CarlitoBrigante is offline
 
Join Date: Nov 2002
Location: Iceland
Posts: 182
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

The search function is the absolute first thing you need to limit/disable if you cannot do other server side changes.
Reply With Quote
  #9  
Old 10-09-2011, 06:27 PM
Simon Lloyd's Avatar
Simon Lloyd Simon Lloyd is offline
 
Join Date: Aug 2008
Location: Manchester
Posts: 3,481
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Spiders from china...etc cause a huge load, i dropped mine drastically by blocking them, here's something i created to do that https://vborg.vbsupport.ru/showthread.php?t=268208 thats the vb4 version but there is a vb3 version too, try it, block the chinese bots like:
baidu
soso
sogou
yeti
yandex
omgili
Youdao
psbot
speedy
spinn3r
ichiro

To name a few , within 30 minutes you should see the load on your server drop.
Reply With Quote
  #10  
Old 10-10-2011, 02:24 PM
Reinier324 Reinier324 is offline
 
Join Date: Jun 2011
Posts: 20
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

What about Cloudflare?
Prevents against bots, zombies, and increases the performance.

I have a small forum but it reduced:
884.7 MB bandwidth saved by CloudFlare
3.8 GB total bandwidth

cloudflare.com
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 12:01 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.06183 seconds
  • Memory Usage 2,262KB
  • Queries Executed 13 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (4)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (10)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete