Server Load and Memory Issues. Modification doing this?

[markbolyard]

For the last few months, and worse now than in the past, our VPS at Monksdiner has been using all it's resources and crashing. After determining it was in fact monksdiner, and not another site on the VPS, I started going through error messages and processes, but haven't been able to pinpoint the problem. Perhaps someone here has first hand knowledge of which one, or more of the following Modifications could use extreme amounts of memory (seems the server keeps maxing out kmemsize). So, here is a list of modifications at monks. Any thoughts on this? You opinion is appreciated.

ibProArcade - Forum Home Stats v1.0
Activity Modification v2.71
Catagory Icons v1.0.1
Cyb - Advanced Forum Statistics v4.2
Cyb - Attention Zero-Posters v1.3
Cyb - Top Posters In Month X 1.0
Display Unread Posts v1.13
Framed URL Redirect v1.0
Guest Tracking v1.09
ibProArcade for vBulletin v2.5.7
Latest Threads IN Marquee v1.0.1
Limited Guest Viewing v1.0.5
Mass PM Members v1.0
Member Bots v1.0
Members who have visited the forum v4.21
Post Groan Hack v2.0
Post Thank You Hack v5.3
Separate Sticky and Normal Threads v1.0.5
Thread Description v1.0.0
Total vBShout Shouts v1.0.0
vB Staff Titles v1.0
vbBux / vbPlaza v1.5.8
vBGuides: Seasonal Effects v1.0.0
vBookie v1.0.7
vBSEO :: Sitemap Generator v1.6.1
vBShout v2.1
Welcome Headers v4.1.2
Zoints Profile System v2.0.8


Here is one report from our host if that might help with determining what is causing our problems:

Your problem regarding the load average is you have mysql currently using almost 90% of your CPU (and a LOT of memory... over 100MB).

There appears to be hung threads or that you have persistant connections enabled.

-bash-3.00# mysqladmin processlist *****
+------+----------------+-----------+----------------+---------+------+----------------+------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info |
+------+----------------+-----------+----------------+---------+------+----------------+------------------------------------------------------------------------------------------------------+
| 593 | eximstats | localhost | eximstats | Sleep | 221 | | |
| 6554 | monksdin_***** | localhost | monksdin_forum | Sleep | 729 | | |
| 6633 | monksdin_***** | localhost | monksdin_forum | Sleep | 666 | | |
| 6742 | monksdin_***** | localhost | monksdin_forum | Sleep | 540 | | |
| 6859 | monksdin_***** | localhost | monksdin_forum | Sleep | 416 | | |
| 6867 | monksdin_***** | localhost | monksdin_forum | Sleep | 406 | | |
| 6894 | monksdin_***** | localhost | monksdin_forum | Sleep | 335 | | |
| 7235 | monksdin_***** | localhost | monksdin_forum | Query | 1 | Sending data | select count(*) as lastposts from vb_post where visible = 1 and dateline >= 1170102437 |
| 7236 | monksdin_***** | localhost | monksdin_forum | Query | 5 | Sending data | select count(*) as lastposts from vb_post where visible = 1 and dateline >= 1170102437 |
| 7238 | monksdin_***** | localhost | monksdin_forum | Query | 2 | Sending data | select count(*) as lastposts from vb_post where visible = 1 and dateline >= 1170102437 |
| 7241 | monksdin_***** | localhost | monksdin_forum | Query | 5 | Sending data | select count(*) as lastposts from vb_post where visible = 1 and dateline >= 1170102438 |
| 7247 | monksdin_***** | localhost | monksdin_forum | Query | 0 | Sending data | select count(*) as lastposts from vb_post where visible = 1 and dateline >= 1170102444 |
| 7248 | monksdin_***** | localhost | monksdin_forum | Query | 3 | Sending data | select count(*) as newposts from vb_post where dateline >= 1170176500 and visible = 1 |
| 7250 | monksdin_***** | localhost | monksdin_forum | Query | 1 | Writing to net | select p.threadid, t.forumid from vb_post p left join vb_thread t on(t.threadid = p.threadid) where |
| 7251 | monksdin_***** | localhost | monksdin_forum | Sleep | 0 | | |
| 7252 | root | localhost | | Query | 0 | | show processlist |
+------+----------------+-----------+----------------+---------+------+----------------+------------------------------------------------------------------------------------------------------+

Notice how you have connections that have been sleeping forever? That's not good in terms of memory, etc.

Thanks to anyone that might have any suggestions.

Mark