vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Big Board Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=172)
-   -   How many servers is your big board on? (https://vborg.vbsupport.ru/showthread.php?t=110072)

dnerty 12-28-2007 03:54 PM

I think my forum is quite big, and it wass running on one server till today. Now I have two servers online :).

TECK 12-28-2007 07:50 PM

Ya, those are nice numbers.. how can you run almost 4,000 users only in one box?
You are a hero. :)

I'm used to spread the server load through workers. Just curious, how high is the server load when you have 3,500 users online? Thanks for the info. I noticed your semi-automatic guns (10k drives and 12GB of RAM). Try if you can the new SAS 15K drives.

dnerty 12-28-2007 08:21 PM

Load is 10-15 with 3000+ users online.. Today I setup a new woodcrest with 2x73GB 15K HDD's :), as MySQL server. Now I need some time for optimization and I beleive those servers could handle 5000 users online.

EricGT 12-28-2007 11:41 PM

The thing that surprises me is the storage solutions I see some of you describing. I've always assumed that interaction with the hard drives would be the bottleneck. I spend a lot of money on really fast RAID systems. My current box has an Adaptec 3805 SATAII RAID card, with 8 Seagate 7,200RPM 750GB SATAII drives, in a RAID 10 configuration. The setup is fast as hell, with decent fault tolerance. This saved my butt a couple of days after I deployed this brand new box. A contractor at my data center arced something in the power box supplying my cabinet and spiked the box. One drive was taken out and the RAID card was damaged, but the system kept running after a restart (albeit with a fair amount of complaining) until I could get down and replace the damaged components. I have drives that big because they weren't much more than the smaller ones and because I am about to start offering image hosting.

What do you guys think is the bear minimum hard drive setup required to run a busy vB system, with both acceptable performance and fault tolerance? Also, what type of external storage is fast enough to use with a vB DB server? Eric

dnerty 12-29-2007 08:32 AM

I would like to have HDD's and RAID like you, but have to take care about every dollar. My clients are crying for money ;).. and, if you are ready to spend some time with your server you really can save some money.

TECK 01-01-2008 12:20 AM

Quote:

Originally Posted by dnerty (Post 1411005)
Load is 10-15 with 3000+ users online.. Today I setup a new woodcrest with 2x73GB 15K HDD's :), as MySQL server. Now I need some time for optimization and I beleive those servers could handle 5000 users online.

With 5,000 users, you need 6 servers. 2 for web, 2 for db and 2 for load balancing (1 is failsafe). Then your server load will be around 0.5-1.5. You cannot run an efficient board while having the load at 15. However, you will obtain much better results if you use a proxy array, instead of spending extra money on 2 cheap balancers.. Serving the data will be ultra fast.

--------------- Added [DATE]1199154184[/DATE] at [TIME]1199154184[/TIME] ---------------

Quote:

Originally Posted by EricGT (Post 1411124)
The thing that surprises me is the storage solutions I see some of you describing. I've always assumed that interaction with the hard drives would be the bottleneck. I spend a lot of money on really fast RAID systems. My current box has an Adaptec 3805 SATAII RAID card, with 8 Seagate 7,200RPM 750GB SATAII drives, in a RAID 10 configuration. The setup is fast as hell, with decent fault tolerance. This saved my butt a couple of days after I deployed this brand new box. A contractor at my data center arced something in the power box supplying my cabinet and spiked the box. One drive was taken out and the RAID card was damaged, but the system kept running after a restart (albeit with a fair amount of complaining) until I could get down and replace the damaged components. I have drives that big because they weren't much more than the smaller ones and because I am about to start offering image hosting.

What do you guys think is the bear minimum hard drive setup required to run a busy vB system, with both acceptable performance and fault tolerance? Also, what type of external storage is fast enough to use with a vB DB server? Eric

You should bump the drives to 15K SAS RAID10, especially for your db servers.
You are killing your servers with SATA, as we speak.

And instead of load balancer hardware, you should try nginx with few workers set in proxy.
It will blow your mind, speed wise.

EricGT 01-01-2008 01:52 AM

Quote:

Originally Posted by TECK (Post 1412948)
With 5,000 users, you need 6 servers. 2 for web, 2 for db and 2 for load balancing (1 is failsafe). Then your server load will be around 0.5-1.5. You cannot run an efficient board while having the load at 15. However, you will obtain much better results if you use a proxy array, instead of spending extra money on 2 cheap balancers.. Serving the data will be ultra fast.

--------------- Added [DATE]1199154184[/DATE] at [TIME]1199154184[/TIME] ---------------


You should bump the drives to 15K SAS RAID10, especially for your db servers.
You are killing your servers with SATA, as we speak.

And instead of load balancer hardware, you should try nginx with few workers set in proxy.
It will blow your mind, speed wise.

This is a powerful server, but it was still built on a tight budget and the extra expense could not be justified. At any rate, the current setup is lightning fast and handling the load just fine. I'll check out nginx, but when I need load balancing again, I will probably use the system built into the Astaro firewall I use. Thanks for the tip though. Eric

Hornstar 01-01-2008 12:42 PM

Yeah, I am in the process of learning as much as I can about splitting the load on 2 servers, as I am ready to go with 2 servers myself. Any useful links on the web about this stuff would be handy. For now i'll just keep reading each and every thing I see about it ^^

user_not_found 01-01-2008 01:05 PM

Currently 1 server - 2,4GHz HT with 2GB RAM.

dnerty 01-04-2008 12:15 PM

Quote:

Originally Posted by TECK (Post 1412948)
With 5,000 users, you need 6 servers. 2 for web, 2 for db and 2 for load balancing (1 is failsafe). Then your server load will be around 0.5-1.5. You cannot run an efficient board while having the load at 15. However, you will obtain much better results if you use a proxy array, instead of spending extra money on 2 cheap balancers.. Serving the data will be ultra fast.

--------------- Added [DATE]1199154184[/DATE] at [TIME]1199154184[/TIME] ---------------

Just finished with moving my databases to a new server.. Now I have 3500 users online with 2-3 load on web server, 0.3 - 0-6 on mysql server :).. Forum.hr And didn't finished with optimisation yet, I will have lower values in a few days :D

lauxanh 01-05-2008 10:08 PM

What webserver are you using?
Litespeed is great and Ngix too.

Btw, That FORUM would make tons of money from adsense :D

TECK 01-07-2008 04:21 PM

I prefer Nginx. With the money I save from Litespeed Enterprise license, I put another grand on top and buy a very good server. :)

dnerty 01-09-2008 08:27 AM

I use good old Apache 1.3 :)

chuanjer 01-11-2008 07:44 AM

We are having 5 web servers and 1 db for our board.
Our board generates about 20+M pageviews/mth with approx 1300 - 2500 users online (as reported by vB on a 900 secs timeout)

However, the access is pretty slow and recently our db load is very erratic. It can jump to 100!!!
Refer to http://www.vbulletin.com/forum/showthread.php?p=1485653

Anyone can share with us on how to optimize our setup? Our servers are installed with off-the-box RHEL4. We do not have knowledge on how to custom build kernels or modules.

Apparently that way seems to be the most efficient to keep load down and serve out fast.
Anyone can share where to find such info.

For those who indicated 2 dbs, how is your setup like? How to have 2 dbs in 1 vB installation?

dnerty 01-12-2008 06:07 AM

It's hard to say without deep into servers..

GotVtec 01-15-2008 12:32 PM

V6Performance Networks
Users: 23k+
Threads: 82k+
Posts: 1.2 million
http://www.big-boards.com/board/1015/

All on 1 server.

Digma 01-17-2008 08:24 AM

Users: 14k+
Threads: 40k+
Posts: 1.5m+

Server(s): 1

Specs:
- Xeon Quad Core 3220 @ 2.4ghz
- 2GB RAM
- 147GB SA-SCSI 15k RPM
- 250GB SATA II (backup)
- 2TB bandwidth.

PSS 01-19-2008 04:40 PM

http://photography-on-the.net/forum

Big-boards rank ca. 250 and going up.
Alexa rank ca. 12,500
2000-3000 users online 24/7
4,7 million posts
135,000 members


One server:
RHEL 5 64-bit
Sphinx search
Litespeed Enterprise Server 3
2 x Intel Xeon-Woodcrest 5148
8GB RAM
2x SAS-SCSI (15k rpm) + SATA + NAS

Server can handle much more than above needs, it's on light load now.

--------------- Added [DATE]1200784410[/DATE] at [TIME]1200784410[/TIME] ---------------

Quote:

Originally Posted by TECK (Post 1412948)
With 5,000 users, you need 6 servers.

Sorry but that is simply not true.

Quote:

Then your server load will be around 0.5-1.5. You cannot run an efficient board while having the load at 15.
Load is essentially "processes in queue". 1*cores load means all works in about realtime. To interpret any loads higher than that is not that straighforward. What those processes are, are their queuing really slowing things down, how long do the queued processes need to execute etc?

lauxanh 03-30-2008 04:16 AM

Wow,

that is impressive.

Would you mind share us your config for Litespeed? i have a board with that much of member online but less post and thread. Running on Xeon 5335 with 4GB of ram and 73GB SCSI for both webserver and database.

But at peak it low down.

Thanks

alexi 03-30-2008 07:05 PM

Quote:

Originally Posted by PSS (Post 1424561)
http://photography-on-the.net/forum

Big-boards rank ca. 250 and going up.
Alexa rank ca. 12,500
2000-3000 users online 24/7
4,7 million posts
135,000 members


One server:
RHEL 5 64-bit
Sphinx search
Litespeed Enterprise Server 3
2 x Intel Xeon-Woodcrest 5148
8GB RAM
2x SAS-SCSI (15k rpm) + SATA + NAS

Server can handle much more than above needs, it's on light load now.

--------------- Added [DATE]1200784410[/DATE] at [TIME]1200784410[/TIME] ---------------



Sorry but that is simply not true.



Load is essentially "processes in queue". 1*cores load means all works in about realtime. To interpret any loads higher than that is not that straighforward. What those processes are, are their queuing really slowing things down, how long do the queued processes need to execute etc?

I can see this. I can't believe the load difference since we switched to a SAN. I would think NAS would have the same functionality. It really seems to be all about the drives. I'm not about to try it but I bet I could get away with not having seperate front end servers.


All times are GMT. The time now is 01:02 PM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01416 seconds
  • Memory Usage 1,795KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (7)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (20)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete