Big Board - Datastore Setup has large amount of memory.

[Hastin]

Hello All,

Seem to be having an issue with my board (18k members, 2.1 million posts). My datastore memory usage seems high - about 7M. We just switch to a new server (Dual Opteron, 4GB of RAM), and during our popular time (about 1k members), we are still eating up though it. Load on the CPU is fine, but memory usage goes through the roof.

I've got xcache going for both PHP, and the datastore. As well, I've got sphinx search for the searching. I've disabled all my hacks, and then checked the usage, and it's about the same. Any other tips?

Thanks!

Datastore Setup
Time Before: 0.00286 seconds
Time After: 0.04625 seconds
Time Taken: 0.04339 seconds

Memory Before: 321.609 KB
Memory After: 7,379.039 KB
Memory Used: 7,057.430 KB

[Zachery]

How many usergroups and forums do you have?

[Hastin]

We've got a club thing going on, so I'd say there's about 40 usergroups, and 60ish forums.

Is that too many?

[Zachery]

Its not too many but its why you're going to see such high memory values. Its got to load permissions for every forum and every usergroup on the forumhome.

[Hastin]

Okay. We were thinking of breaking out to a new system, and this is the kicker. :)

[Zachery]

Reducing your usergroups would be a good first step, or at least trying to consoldate if possible.

[Marco van Herwaarden]

I do the technical administration of a board that has an similar server. Concurrent online users vary from ~600 up to peaks of ~2.400. The board has over 600 forums :eek: with around 20 usergroups, a very bad style (from performance POV) and a few modifications that also add up to degrading the performance. It however runs smooth most of the time. Only at the real extreme peaks (we sometimes go from 1.000 to over 2.200 in just a few minutes) combined with the mail server sending out an mail listing, we do have a short degradation of the responsetimes.

What harddisk do you use?

Also did you already try posting in the Server Configuration forum at vBulletin.com?

[Dismounted]

I do the technical administration of a board that has an similar server. Concurrent online users vary from ~600 up to peaks of ~2.400. The board has over 600 forums :eek: with around 20 usergroups, a very bad style (from performance POV) and a few modifications that also add up to degrading the performance. It however runs smooth most of the time. Only at the real extreme peaks (we sometimes go from 1.000 to over 2.200 in just a few minutes) combined with the mail server sending out an mail listing, we do have a short degradation of the responsetimes.
Now that's we call a BIG board :p.

[edgecutioner]

Now that's we call a BIG board :p.

aren't I a fool to think that my board was big... anyways, i'm satisfied with it and isn't that the goal of every forums? to make every member happy? :)

[Marco van Herwaarden]

Actually i do not even consider that as a big board, medium sized maybe, or high-medium based on the extensive use of sub-forums and other resource intensive stuff. A real big board would need to run on a good multi-server setup.