What needs to handle 2500 users online at once

[AndrewSimm]

On 01/05 we had over 1,200 online at once and I expect around 2,500 on 02/06. There will be several times that day when post will spike to about 800 in about a 10 second span. Currently I have

Intel Xeon E3-1230 V2 3.3GHz
100 mbps Uplink
16 GB DDR3 Memory
1 TB RAID-1 Drives
10 TB Bandwidth

My current host is hostgator and we are getting around 230,000 pageviews a day. I expect over 500,000 on NSD.

When we had 1,200 online things got really slow and almost crashed. What are some suggestions and does anyone have any experience with vbulletin and amazon aws. I got a vanilla install up but had issues importing my database due to the mysql memory size on amazon RDS.

For those with experience is amazon the way to go or multiple servers? Also what about rackspace and how do they compare to amazon?

[Max Taxable]

Are all of these actual human users, or mostly "Guests?" Eliminate most of the automated bandwidth leeches by blocking Baidu and other bad user agents. Use this Mod for that:

Ban Spiders by User Agent (https://vborg.vbsupport.ru/showthread.php?t=264932)

Link to the 4.x.x version and some nice lists of bad actors to block, in the thread. Cut your leech traffic almost totally out.

[AndrewSimm]

No they are human. We do a pretty good job with the spiders.

[Max Taxable]

No they are human. We do a pretty good job with the spiders.1,200 to 2,000 human, logged in users online?

I gotta see this great board, link please?

[snakes1100]

You've never seen a site like that MT?

Ill PM you a couple lol

You would need to give us a bit more detail about the servers state when it loads up, cpu usage, ram usage, disk i/o stats etc.

[AndrewSimm]

<a href="http://canesinsight.com" target="_blank">http://canesinsight.com</a>

Isn't that busy right now. Currently There are currently 808 users online. 664 members and 144 guests

[Max Taxable]

You've never seen a site like that MT?.Actually I have, just like to see more of them.http://canesinsight.com

Isn't that busy right now. Currently There are currently 808 users online. 664 members and 144 guestsThanks! It looks GREAT!

[AndrewSimm]

Actually I have, just like to see more of them.Thanks! It looks GREAT!

thanks, I am just worried about the crashing.

[snakes1100]

You would need to give us a bit more detail about the servers state when it loads up, cpu usage, ram usage, disk i/o stats etc.

Any info?

[Max Taxable]

thanks, I am just worried about the crashing.I would be too.

[AndrewSimm]

Currently

2.95 4.03 5.29 | 1,043 Users Online (830 members and 213 guests)

It spikes during announcements. Basically I get post bombed.

--------------- Added 1358997646 at 1358997646 ---------------

Running apache, nginx, and DP Sphinx, Tables are still MyISAM

[snakes1100]

Rather high load for that amount of users on, but we dont know much about your setup without details.

nginx & apache may not be tuned/optimized.

hacks installed make a difference.

no cache installed?

the disk setup you have isnt very good for a db server.

[AndrewSimm]

I am not running a lot of hacks. vBDynamics and vbGallery but those don't get a lot of traffic. Datastore in the file system. No memcache or xcache yet.

[snakes1100]

File based caching is not as fast as memory.

Without know nginx & apache conf, not much more can really be said, not to mention is if sql is optimized as well.

With slow 1tb sata drives, thats not going to be good performance wise, for sql either.

[final kaoss]

It shows that alot of your resources aren't being cached.

I suggest you do the following.

*Install cloudflare and disable it's rocketloader feature. It can help serve content as a cdn as well as help block attackers/bad bots.

*Install the htaccess found in my guide to help with caching, gzip & more.

*Try out vb4 supercharged.

*Optimize your images

*Where possible, add css sprites.

And last but not least, make a post here to help fine tune your server hardware/software.
https://www.vbulletin.com/forum/forumdisplay.php/14-Server-Configuration
If you need help with any of the above, simply look in my signature for the link to the popular guide.

[nhawk]

I don't know why you're running Apache and Nginx, but it should be one or the other. Not both.

Normally when Nginx is installed apache is disabled.

[snakes1100]

It shows that alot of your resources aren't being cached.

I suggest you do the following.

*Install cloudflare and disable it's rocketloader feature. It can help serve content as a cdn as well as help block attackers/bad bots.

Cloudfare is a bad idea on a large heavy traffic site like his.

*Install the htaccess found in my guide to help with caching, gzip & more.

He dont need to, thats already being done by nginx if its setup correctly

*Try out vb4 supercharged.

That hack hasnt been updated in over a year & dont work correctly on later versions of vb.

*Optimize your images

*Where possible, add css sprites.

And last but not least, make a post here to help fine tune your server hardware/software.
https://www.vbulletin.com/forum/forumdisplay.php/14-Server-Configuration
If you need help with any of the above, simply look in my signature for the link to the popular guide.

I don't know why you're running Apache and Nginx, but it should be one or the other. Not both.

Normally when Nginx is installed apache is disabled.

Nhawk, nginx is in proxy mode, then passes the php process off to apache, nginx is caching images & gzipping content to name a few, as well as handling a wide range of attacks that apache could never handle that are built into nginx by default.

[final kaoss]

Sorry snake but the points you've highlighted in red are null & void as per the results of a webpagetest & yslow report.

Also, cloudflare is a good choice for any site, as they help to serve content & thus reduce the amount of static requests that each page requires to load. It does not in anyway make site performance worse.

http://www.webpagetest.org/pagespeed.php?test=130124_HA_JM8&run=1&cached=0

As you can see, the points you tried to argue against are not being done by his current setup, hence why I posted what I posted.

Also, vb4 supercharged is working fine for me regardless of how old it is, I still use it to this day and recommend it.
Nhawk, nginx is in proxy mode, then passes the php process off to apache, nginx is caching images & gzipping content to name a few, as well as handling a wide range of attacks that apache could never handle that are built into nginx by default.

[snakes1100]

Sorry snake but the points you've highlighted in red are null & void as per the results of a webpagetest & yslow report.

Also, cloudflare is a good choice for any site, as they help to serve content & thus reduce the amount of static requests that each page requires to load. It does not in anyway make site performance worse.

http://www.webpagetest.org/pagespeed.php?test=130124_HA_JM8&run=1&cached=0

As you can see, the points you tried to argue against are not being done by his current setup, hence why I posted what I posted.

Apparently, you dont read either, you should try to read what i said again, the points are valid & you gave very bad advice on a few points.

1. You tell him to use a hack that dont even work & is full of bugs.

2. I stated if his nginx was setup right, he dont need to, so apparently its not setup right.

[final kaoss]

1. With the correct settings vb4 supercharged works just fine for combining js & css, that is all that you really need it for since there are other ways to cache it & compress it without relying on the plugin to do it for you. Also what bugs are there with it? With the advice from my article you can run it pretty much with zero worries.

For this step, we need to install vb supercharged. WARNING! Some people have reported conflicts when using this mod with other mod's. With Google Closure Compiler OFF, I have not encountered any conflicts!

My advice is to enable every option except for these:
Html Optimiser
Javascript Optimiser
Attachment Optimiser

2. I realize that you was stating this as well and I pointed it out with a report.

Apparently, you dont read either, you should try to read what i said again, the points are valid & you gave very bad advice on a few points.

1. You tell him to use a hack that dont even work & is full of bugs.

2. I stated if his nginx was setup right, he dont need to, so apparently its not setup right.

[snakes1100]

1. With the correct settings vb4 supercharged works just fine for combining js & css, that is all that you really need it for since there are other ways to cache it & compress it without relying on the plugin to do it for you. Also what bugs are there with it? With the advice from my article you can run it pretty much with zero worries.

My advice is to enable every option except for these:
Html Optimiser
Javascript Optimiser
Attachment Optimiser


Thats a lot of options your disabling for a hack that works right.

[final kaoss]

Yep but I've been able to throw just about any mod I want onto it with no worries with it setup like that, including chats & arcades to test with.

[AndrewSimm]

I tried the super charged mod about a year ago and had some issues with it. I am already using gzip

my htaccess is below if you would like to look at it.

I noticed an improvement when I set up ngnix. Maybe it could be done better but it seems to be working in some capacity.

Does anyone have a link to some independent benchmarks done with cloudflare?



RewriteOptions inherit
####Charset
AddDefaultCharset Off

## Expires
<ifModule mod_expires.c>
ExpiresActive On
ExpiresDefault "access plus 1 seconds"
ExpiresByType text/html "access plus 1 seconds"
ExpiresByType image/gif "access plus 3456000 seconds"
ExpiresByType image/jpeg "access plus 3456000 seconds"
ExpiresByType image/png "access plus 3456000 seconds"
ExpiresByType text/css "access plus 3456000 seconds"
ExpiresByType text/javascript "access plus 3456000 seconds"
ExpiresByType application/javascript "access plus 3456000 seconds"
ExpiresByType application/x-javascript "access plus 3456000 seconds"
</ifModule>

## Compression
<ifmodule mod_headers.c>
<ifmodule mod_deflate.c>
AddOutputFilterByType DEFLATE text/html text/css text/xml application/x-javascript
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
</ifmodule>
</ifmodule>

## Rewrites
<ifmodule mod_rewrite.c>
RewriteEngine on
DirectoryIndex index.php

ReWriteRule ^media/m(\d+).*/tags$ media.php?do=tags_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/edit$ media.php?do=details_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/report$ media.php?do=report&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/c(\d+)$ media.php?do=comment_edit&cmt=$2 [QSA]
ReWriteRule ^media/m(\d+).*/p(\d+).*$ media.php?do=details&mid=$1&pid=$2 [QSA]
ReWriteRule ^media/m(\d+).* media.php?do=details&mid=$1 [QSA]
ReWriteRule ^media/p(\d+).*/edit$ media.php?do=playlist_edit&pid=$1 [QSA]
ReWriteRule ^media/p(\d+).* media.php?do=playlist&pid=$1 [QSA]
ReWriteRule ^media/c(\d+).* media.php?do=category&cid=$1 [QSA]
ReWriteRule ^media/u(\d+).* media.php?do=user&uid=$1 [QSA]
ReWriteRule ^media/tag/(.*) media.php?do=tag&tid=$1 [QSA]
ReWriteRule ^media/results/(.*) media.php?do=results&query=$1 [QSA]
ReWriteRule ^media/advresults/(.*) media.php?do=advresults&query=$1 [QSA]
ReWriteRule ^media/letter/(.*) media.php?do=letter&query=$1 [QSA]
ReWriteRule ^media/browse.* media.php?do=browse [QSA]
ReWriteRule ^media/search.* media.php?do=search [QSA]
ReWriteRule ^media/random.* media.php?do=random [QSA]
ReWriteRule ^media/submit.* media.php?do=submit [QSA]
ReWriteRule ^media/tagcloud.* media.php?do=tagcloud [QSA]
ReWriteRule ^media/playlists.* media.php?do=playlists [QSA]
ReWriteRule ^media/pcreate.* media.php?do=playlists_create [QSA]
ReWriteRule ^media/pmine.* media.php?do=playlists_mine [QSA]
ReWriteRule ^media/favorites.* media.php?do=favorites [QSA]
ReWriteRule ^media/subscriptions.* media.php?do=subscriptions [QSA]
ReWriteRule ^media/admin/edit/s(\d+).* media.php?do=admin_host_edit&sid=$1 [QSA]
ReWriteRule ^media/admin/delete/s(\d+).* media.php?do=admin_host_delete&sid=$1 [QSA]
ReWriteRule ^media/admin/export/s(\d+).* media.php?do=admin_host_export&sid=$1 [QSA]
ReWriteRule ^media/admin/(\w+).* media.php?do=admin_$1 [QSA]

# Media Library from Video Directory
RewriteCond %{QUERY_STRING} do=viewdetails&videoid=(\d+)
RewriteRule ^video\.php$ media.php?do=details&mid=%1
RewriteCond %{QUERY_STRING} viewcategory&categoryid=(\d+)
RewriteRule ^video\.php$ media.php?do=category&cid=%1
RewriteCond %{QUERY_STRING} viewuser&userid=(\d+)
RewriteRule ^video\.php$ media.php?do=user&uid=%1
RewriteCond %{QUERY_STRING} viewtag&tag=(.*)
RewriteRule ^video\.php$ media.php?do=tag&tid=%1
ReWriteRule ^video\.php$ media.php

# Send hardcoded ipa scores to arcade instead
RewriteCond %{QUERY_STRING} act=Arcade [OR]
RewriteCond %{QUERY_STRING} autocom=arcade
RewriteRule ^index.php arcade.php [L,QSA]

</ifmodule>

<Files 403.shtml>
order allow,deny
allow from all
</Files>

Options -Indexes
deny from 71.76.197.71
deny from 193.200.150.125
deny from 173.63.38.218
deny from 67.159.60.83
deny from 89.145.95.2

RewriteCond %{HTTP_HOST} ^www.canesinsight.com$ [NC]
RewriteRule ^(.*)$ http://canesinsight.com/$1 [R=301,L]

deny from 72.228.132.15
RewriteCond %{HTTP_HOST} ^canesinsight\.co$ [OR]
RewriteCond %{HTTP_HOST} ^www\.canesinsight\.co$
RewriteRule ^/?$ "http\:\/\/canesinsight\.com" [R=301,L]



--------------- Added 1359080196 at 1359080196 ---------------

I don't know why you're running Apache and Nginx, but it should be one or the other. Not both.

Normally when Nginx is installed apache is disabled.

I installed it as a cpanel plugin. I believe it comes set for nginx to serve the static content and apache the dynamic. I didn't see a easy way to just turn apache off and use nginx and didn't want to screw things up in my two busiest weeks of the year.

[final kaoss]

Here is the modified htaccess that I recommend for you (includes all of your old rewrite rules yet improves upon the caching/gzip.)

Although if you use cloudflare you would want to load only www urls and no urls that do not have www.
https://discussion.dreamhost.com/thread-136317-post-158213.html#pid158213


RE: Cloudflare without "www"
Hi,

Using CloudFlare through the panel option requires the www entry (DNS RFC compliance only allows us to provision via CNAME).

Note: This does not apply if you are signing up directly for CloudFlare.

# Author: Final Kaoss (aka: Extreme-Gaming)
# Version 2.7
RewriteEngine on

# This file is only needed if you have set the Forum Component URL in your admincp and you are
# using the mod_rewrite option for friendly urls. If this is the case, copy this file
# to your forum component stub directory.

## Rewrites
<ifmodule mod_rewrite.c>
RewriteEngine on
DirectoryIndex index.php

ReWriteRule ^media/m(\d+).*/tags$ media.php?do=tags_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/edit$ media.php?do=details_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/report$ media.php?do=report&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/c(\d+)$ media.php?do=comment_edit&cmt=$2 [QSA]
ReWriteRule ^media/m(\d+).*/p(\d+).*$ media.php?do=details&mid=$1&pid=$2 [QSA]
ReWriteRule ^media/m(\d+).* media.php?do=details&mid=$1 [QSA]
ReWriteRule ^media/p(\d+).*/edit$ media.php?do=playlist_edit&pid=$1 [QSA]
ReWriteRule ^media/p(\d+).* media.php?do=playlist&pid=$1 [QSA]
ReWriteRule ^media/c(\d+).* media.php?do=category&cid=$1 [QSA]
ReWriteRule ^media/u(\d+).* media.php?do=user&uid=$1 [QSA]
ReWriteRule ^media/tag/(.*) media.php?do=tag&tid=$1 [QSA]
ReWriteRule ^media/results/(.*) media.php?do=results&query=$1 [QSA]
ReWriteRule ^media/advresults/(.*) media.php?do=advresults&query=$1 [QSA]
ReWriteRule ^media/letter/(.*) media.php?do=letter&query=$1 [QSA]
ReWriteRule ^media/browse.* media.php?do=browse [QSA]
ReWriteRule ^media/search.* media.php?do=search [QSA]
ReWriteRule ^media/random.* media.php?do=random [QSA]
ReWriteRule ^media/submit.* media.php?do=submit [QSA]
ReWriteRule ^media/tagcloud.* media.php?do=tagcloud [QSA]
ReWriteRule ^media/playlists.* media.php?do=playlists [QSA]
ReWriteRule ^media/pcreate.* media.php?do=playlists_create [QSA]
ReWriteRule ^media/pmine.* media.php?do=playlists_mine [QSA]
ReWriteRule ^media/favorites.* media.php?do=favorites [QSA]
ReWriteRule ^media/subscriptions.* media.php?do=subscriptions [QSA]
ReWriteRule ^media/admin/edit/s(\d+).* media.php?do=admin_host_edit&sid=$1 [QSA]
ReWriteRule ^media/admin/delete/s(\d+).* media.php?do=admin_host_delete&sid=$1 [QSA]
ReWriteRule ^media/admin/export/s(\d+).* media.php?do=admin_host_export&sid=$1 [QSA]
ReWriteRule ^media/admin/(\w+).* media.php?do=admin_$1 [QSA]

# Media Library from Video Directory
RewriteCond %{QUERY_STRING} do=viewdetails&videoid=(\d+)
RewriteRule ^video\.php$ media.php?do=details&mid=%1
RewriteCond %{QUERY_STRING} viewcategory&categoryid=(\d+)
RewriteRule ^video\.php$ media.php?do=category&cid=%1
RewriteCond %{QUERY_STRING} viewuser&userid=(\d+)
RewriteRule ^video\.php$ media.php?do=user&uid=%1
RewriteCond %{QUERY_STRING} viewtag&tag=(.*)
RewriteRule ^video\.php$ media.php?do=tag&tid=%1
ReWriteRule ^video\.php$ media.php

# Send hardcoded ipa scores to arcade instead
RewriteCond %{QUERY_STRING} act=Arcade [OR]
RewriteCond %{QUERY_STRING} autocom=arcade
RewriteRule ^index.php arcade.php [L,QSA]

</ifmodule>

<Files 403.shtml>
order allow,deny
allow from all
</Files>

Options -Indexes
deny from 71.76.197.71
deny from 193.200.150.125
deny from 173.63.38.218
deny from 67.159.60.83
deny from 89.145.95.2

RewriteCond %{HTTP_HOST} ^www.canesinsight.com$ [NC]
RewriteRule ^(.*)$ http://canesinsight.com/$1 [R=301,L]

deny from 72.228.132.15
RewriteCond %{HTTP_HOST} ^canesinsight\.co$ [OR]
RewriteCond %{HTTP_HOST} ^www\.canesinsight\.co$
RewriteRule ^/?$ "http\:\/\/canesinsight\.com" [R=301,L]


#Deny attempts to view the Htaccess file.
<Files .htaccess>
Order allow,deny
Deny from all
</Files>
# BEGIN Browser Caching/Headers
<IfModule mod_mime.c>
AddType text/css .css
AddType text/richtext .rtf .rtx
AddType image/svg+xml .svg .svgz
AddType text/plain .txt
AddType text/xsd .xsd
AddType text/xsl .xsl
AddType video/asf .asf .asx .wax .wmv .wmx
AddType video/avi .avi
AddType image/bmp .bmp
AddType application/java .class
AddType video/divx .divx
AddType application/msword .doc .docx
AddType application/x-msdownload .exe
AddType image/gif .gif
AddType application/x-gzip .gz .gzip
AddType image/x-icon .ico
AddType image/jpeg .jpg .jpeg .jpe
AddType application/vnd.ms-access .mdb
AddType audio/midi .mid .midi
AddType video/quicktime .mov .qt
AddType audio/mpeg .mp3 .m4a
AddType video/mp4 .mp4 .m4v
AddType video/mpeg .mpeg .mpg .mpe
AddType application/vnd.ms-project .mpp
AddType application/vnd.oasis.opendocument.database .odb
AddType application/vnd.oasis.opendocument.chart .odc
AddType application/vnd.oasis.opendocument.formula .odf
AddType application/vnd.oasis.opendocument.graphics .odg
AddType application/vnd.oasis.opendocument.presentation .odp
AddType application/vnd.oasis.opendocument.spreadsheet .ods
AddType application/vnd.oasis.opendocument.text .odt
AddType audio/ogg .ogg
AddType application/pdf .pdf
AddType image/png .png
AddType application/vnd.ms-powerpoint .pot .pps .ppt .pptx
AddType audio/x-realaudio .ra .ram
AddType application/x-shockwave-flash .swf
AddType application/x-tar .tar
AddType image/tiff .tif .tiff
AddType audio/wav .wav
AddType audio/wma .wma
AddType application/vnd.ms-write .wri
AddType application/vnd.ms-excel .xla .xls .xlsx .xlt .xlw
AddType application/zip .zip
</IfModule>
<IfModule mod_expires.c>
ExpiresActive On
ExpiresByType text/css A2628000
ExpiresByType text/richtext A3600
ExpiresByType image/svg+xml A3600
ExpiresByType text/plain A3600
ExpiresByType text/xsd A3600
ExpiresByType text/xsl A3600
ExpiresByType video/asf A2628000
ExpiresByType video/avi A2628000
ExpiresByType image/bmp A2628000
ExpiresByType application/java A2628000
ExpiresByType video/divx A2628000
ExpiresByType application/msword A2628000
ExpiresByType application/x-msdownload A2628000
ExpiresByType image/gif A2628000
ExpiresByType application/x-gzip A2628000
ExpiresByType image/x-icon A2628000
ExpiresByType image/jpeg A2628000
ExpiresByType application/vnd.ms-access A2628000
ExpiresByType audio/midi A2628000
ExpiresByType video/quicktime A2628000
ExpiresByType audio/mpeg A2628000
ExpiresByType video/mp4 A2628000
ExpiresByType video/mpeg A2628000
ExpiresByType application/vnd.ms-project A2628000
ExpiresByType application/vnd.oasis.opendocument.database A2628000
ExpiresByType application/vnd.oasis.opendocument.chart A2628000
ExpiresByType application/vnd.oasis.opendocument.formula A2628000
ExpiresByType application/vnd.oasis.opendocument.graphics A2628000
ExpiresByType application/vnd.oasis.opendocument.presentation A2628000
ExpiresByType application/vnd.oasis.opendocument.spreadsheet A2628000
ExpiresByType application/vnd.oasis.opendocument.text A2628000
ExpiresByType audio/ogg A2628000
ExpiresByType application/pdf A2628000
ExpiresByType image/png A2628000
ExpiresByType application/vnd.ms-powerpoint A2628000
ExpiresByType audio/x-realaudio A2628000
ExpiresByType application/x-shockwave-flash A2628000
ExpiresByType application/x-tar A2628000
ExpiresByType image/tiff A2628000
ExpiresByType audio/wav A2628000
ExpiresByType audio/wma A2628000
ExpiresByType application/vnd.ms-write A2628000
ExpiresByType application/vnd.ms-excel A2628000
ExpiresByType application/zip A2628000
</IfModule>
<IfModule mod_deflate.c>
<IfModule mod_setenvif.c>
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html
</IfModule>
<IfModule mod_headers.c>
Header append Vary User-Agent env=!dont-vary
</IfModule>
<IfModule mod_filter.c>
AddOutputFilterByType DEFLATE text/css application/x-javascript text/html text/richtext image/svg+xml text/plain text/xsd text/xsl text/xml image/x-icon
</IfModule>
</IfModule>
<FilesMatch "\.(css|CSS|)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
<FilesMatch "\.(rtf|rtx|svg|svgz|txt|xsd|xsl|RTF|RTX|SVG|SVGZ|T XT|XSD|XSL|)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
<FilesMatch "\.(asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx |exe|gif|gz|gzip|ico|jpg|jpeg|jpe|mdb|mid|midi|mov |qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|odb|odc|odf|o dg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram |swf|tar|tif|tiff|wav|wma|wri|xla|xls|xlsx|xlt|xlw |zip|ASF|ASX|WAX|WMV|WMX|AVI|BMP|CLASS|DIVX|DOC|DO CX|EXE|GIF|GZ|GZIP|ICO|JPG|JPEG|JPE|MDB|MID|MIDI|M OV|QT|MP3|M4A|MP4|M4V|MPEG|MPG|MPE|MPP|ODB|ODC|ODF |ODG|ODP|ODS|ODT|OGG|PDF|PNG|POT|PPS|PPT|PPTX|RA|R AM|SWF|TAR|TIF|TIFF|WAV|WMA|WRI|XLA|XLS|XLSX|XLT|X LW|ZIP)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
# End Browser Caching/Headers

Unfortunately I don't have any benchmark comparisons for before & after cloudflare but here is my latest gtmetrix score on my site that does have cloudflare enabled.
http://gtmetrix.com/reports/www.video-game-chat.com/lcSDSldq

Also I know nothing about nginx rewrite rules atm so I can't help you with that, maybe I'll try to learn it within the coming month's.

[cloferba]

what does ReWriteRule+^media/p(d+).*/edit$+media.php?do=playlist_edit&pid=$1+[QSA] exactly do?

[final kaoss]

That I believe is for some kindof media addon that used to be popular but is now abandoned, brb.

This is the addon that requires all of the "media" rewrites..
https://vborg.vbsupport.ru/showthread.php?t=240677

[AndrewSimm]

Here is the modified htaccess that I recommend for you (includes all of your old rewrite rules yet improves upon the caching/gzip.)

Although if you use cloudflare you would want to load only www urls and no urls that do not have www.
https://discussion.dreamhost.com/thread-136317-post-158213.html#pid158213


# Author: Final Kaoss (aka: Extreme-Gaming)
# Version 2.7
RewriteEngine on

# This file is only needed if you have set the Forum Component URL in your admincp and you are
# using the mod_rewrite option for friendly urls. If this is the case, copy this file
# to your forum component stub directory.

## Rewrites
<ifmodule mod_rewrite.c>
RewriteEngine on
DirectoryIndex index.php

ReWriteRule ^media/m(\d+).*/tags$ media.php?do=tags_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/edit$ media.php?do=details_edit&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/report$ media.php?do=report&mid=$1 [QSA]
ReWriteRule ^media/m(\d+).*/c(\d+)$ media.php?do=comment_edit&cmt=$2 [QSA]
ReWriteRule ^media/m(\d+).*/p(\d+).*$ media.php?do=details&mid=$1&pid=$2 [QSA]
ReWriteRule ^media/m(\d+).* media.php?do=details&mid=$1 [QSA]
ReWriteRule ^media/p(\d+).*/edit$ media.php?do=playlist_edit&pid=$1 [QSA]
ReWriteRule ^media/p(\d+).* media.php?do=playlist&pid=$1 [QSA]
ReWriteRule ^media/c(\d+).* media.php?do=category&cid=$1 [QSA]
ReWriteRule ^media/u(\d+).* media.php?do=user&uid=$1 [QSA]
ReWriteRule ^media/tag/(.*) media.php?do=tag&tid=$1 [QSA]
ReWriteRule ^media/results/(.*) media.php?do=results&query=$1 [QSA]
ReWriteRule ^media/advresults/(.*) media.php?do=advresults&query=$1 [QSA]
ReWriteRule ^media/letter/(.*) media.php?do=letter&query=$1 [QSA]
ReWriteRule ^media/browse.* media.php?do=browse [QSA]
ReWriteRule ^media/search.* media.php?do=search [QSA]
ReWriteRule ^media/random.* media.php?do=random [QSA]
ReWriteRule ^media/submit.* media.php?do=submit [QSA]
ReWriteRule ^media/tagcloud.* media.php?do=tagcloud [QSA]
ReWriteRule ^media/playlists.* media.php?do=playlists [QSA]
ReWriteRule ^media/pcreate.* media.php?do=playlists_create [QSA]
ReWriteRule ^media/pmine.* media.php?do=playlists_mine [QSA]
ReWriteRule ^media/favorites.* media.php?do=favorites [QSA]
ReWriteRule ^media/subscriptions.* media.php?do=subscriptions [QSA]
ReWriteRule ^media/admin/edit/s(\d+).* media.php?do=admin_host_edit&sid=$1 [QSA]
ReWriteRule ^media/admin/delete/s(\d+).* media.php?do=admin_host_delete&sid=$1 [QSA]
ReWriteRule ^media/admin/export/s(\d+).* media.php?do=admin_host_export&sid=$1 [QSA]
ReWriteRule ^media/admin/(\w+).* media.php?do=admin_$1 [QSA]

# Media Library from Video Directory
RewriteCond %{QUERY_STRING} do=viewdetails&videoid=(\d+)
RewriteRule ^video\.php$ media.php?do=details&mid=%1
RewriteCond %{QUERY_STRING} viewcategory&categoryid=(\d+)
RewriteRule ^video\.php$ media.php?do=category&cid=%1
RewriteCond %{QUERY_STRING} viewuser&userid=(\d+)
RewriteRule ^video\.php$ media.php?do=user&uid=%1
RewriteCond %{QUERY_STRING} viewtag&tag=(.*)
RewriteRule ^video\.php$ media.php?do=tag&tid=%1
ReWriteRule ^video\.php$ media.php

# Send hardcoded ipa scores to arcade instead
RewriteCond %{QUERY_STRING} act=Arcade [OR]
RewriteCond %{QUERY_STRING} autocom=arcade
RewriteRule ^index.php arcade.php [L,QSA]

</ifmodule>

<Files 403.shtml>
order allow,deny
allow from all
</Files>

Options -Indexes
deny from 71.76.197.71
deny from 193.200.150.125
deny from 173.63.38.218
deny from 67.159.60.83
deny from 89.145.95.2

RewriteCond %{HTTP_HOST} ^www.canesinsight.com$ [NC]
RewriteRule ^(.*)$ http://canesinsight.com/$1 [R=301,L]

deny from 72.228.132.15
RewriteCond %{HTTP_HOST} ^canesinsight\.co$ [OR]
RewriteCond %{HTTP_HOST} ^www\.canesinsight\.co$
RewriteRule ^/?$ "http\:\/\/canesinsight\.com" [R=301,L]


#Deny attempts to view the Htaccess file.
<Files .htaccess>
Order allow,deny
Deny from all
</Files>
# BEGIN Browser Caching/Headers
<IfModule mod_mime.c>
AddType text/css .css
AddType text/richtext .rtf .rtx
AddType image/svg+xml .svg .svgz
AddType text/plain .txt
AddType text/xsd .xsd
AddType text/xsl .xsl
AddType video/asf .asf .asx .wax .wmv .wmx
AddType video/avi .avi
AddType image/bmp .bmp
AddType application/java .class
AddType video/divx .divx
AddType application/msword .doc .docx
AddType application/x-msdownload .exe
AddType image/gif .gif
AddType application/x-gzip .gz .gzip
AddType image/x-icon .ico
AddType image/jpeg .jpg .jpeg .jpe
AddType application/vnd.ms-access .mdb
AddType audio/midi .mid .midi
AddType video/quicktime .mov .qt
AddType audio/mpeg .mp3 .m4a
AddType video/mp4 .mp4 .m4v
AddType video/mpeg .mpeg .mpg .mpe
AddType application/vnd.ms-project .mpp
AddType application/vnd.oasis.opendocument.database .odb
AddType application/vnd.oasis.opendocument.chart .odc
AddType application/vnd.oasis.opendocument.formula .odf
AddType application/vnd.oasis.opendocument.graphics .odg
AddType application/vnd.oasis.opendocument.presentation .odp
AddType application/vnd.oasis.opendocument.spreadsheet .ods
AddType application/vnd.oasis.opendocument.text .odt
AddType audio/ogg .ogg
AddType application/pdf .pdf
AddType image/png .png
AddType application/vnd.ms-powerpoint .pot .pps .ppt .pptx
AddType audio/x-realaudio .ra .ram
AddType application/x-shockwave-flash .swf
AddType application/x-tar .tar
AddType image/tiff .tif .tiff
AddType audio/wav .wav
AddType audio/wma .wma
AddType application/vnd.ms-write .wri
AddType application/vnd.ms-excel .xla .xls .xlsx .xlt .xlw
AddType application/zip .zip
</IfModule>
<IfModule mod_expires.c>
ExpiresActive On
ExpiresByType text/css A2628000
ExpiresByType text/richtext A3600
ExpiresByType image/svg+xml A3600
ExpiresByType text/plain A3600
ExpiresByType text/xsd A3600
ExpiresByType text/xsl A3600
ExpiresByType video/asf A2628000
ExpiresByType video/avi A2628000
ExpiresByType image/bmp A2628000
ExpiresByType application/java A2628000
ExpiresByType video/divx A2628000
ExpiresByType application/msword A2628000
ExpiresByType application/x-msdownload A2628000
ExpiresByType image/gif A2628000
ExpiresByType application/x-gzip A2628000
ExpiresByType image/x-icon A2628000
ExpiresByType image/jpeg A2628000
ExpiresByType application/vnd.ms-access A2628000
ExpiresByType audio/midi A2628000
ExpiresByType video/quicktime A2628000
ExpiresByType audio/mpeg A2628000
ExpiresByType video/mp4 A2628000
ExpiresByType video/mpeg A2628000
ExpiresByType application/vnd.ms-project A2628000
ExpiresByType application/vnd.oasis.opendocument.database A2628000
ExpiresByType application/vnd.oasis.opendocument.chart A2628000
ExpiresByType application/vnd.oasis.opendocument.formula A2628000
ExpiresByType application/vnd.oasis.opendocument.graphics A2628000
ExpiresByType application/vnd.oasis.opendocument.presentation A2628000
ExpiresByType application/vnd.oasis.opendocument.spreadsheet A2628000
ExpiresByType application/vnd.oasis.opendocument.text A2628000
ExpiresByType audio/ogg A2628000
ExpiresByType application/pdf A2628000
ExpiresByType image/png A2628000
ExpiresByType application/vnd.ms-powerpoint A2628000
ExpiresByType audio/x-realaudio A2628000
ExpiresByType application/x-shockwave-flash A2628000
ExpiresByType application/x-tar A2628000
ExpiresByType image/tiff A2628000
ExpiresByType audio/wav A2628000
ExpiresByType audio/wma A2628000
ExpiresByType application/vnd.ms-write A2628000
ExpiresByType application/vnd.ms-excel A2628000
ExpiresByType application/zip A2628000
</IfModule>
<IfModule mod_deflate.c>
<IfModule mod_setenvif.c>
BrowserMatch ^Mozilla/4 gzip-only-text/html
BrowserMatch ^Mozilla/4\.0[678] no-gzip
BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html
</IfModule>
<IfModule mod_headers.c>
Header append Vary User-Agent env=!dont-vary
</IfModule>
<IfModule mod_filter.c>
AddOutputFilterByType DEFLATE text/css application/x-javascript text/html text/richtext image/svg+xml text/plain text/xsd text/xsl text/xml image/x-icon
</IfModule>
</IfModule>
<FilesMatch "\.(css|CSS|)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
<FilesMatch "\.(rtf|rtx|svg|svgz|txt|xsd|xsl|RTF|RTX|SVG|SVGZ|T XT|XSD|XSL|)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
<FilesMatch "\.(asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx |exe|gif|gz|gzip|ico|jpg|jpeg|jpe|mdb|mid|midi|mov |qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|odb|odc|odf|o dg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram |swf|tar|tif|tiff|wav|wma|wri|xla|xls|xlsx|xlt|xlw |zip|ASF|ASX|WAX|WMV|WMX|AVI|BMP|CLASS|DIVX|DOC|DO CX|EXE|GIF|GZ|GZIP|ICO|JPG|JPEG|JPE|MDB|MID|MIDI|M OV|QT|MP3|M4A|MP4|M4V|MPEG|MPG|MPE|MPP|ODB|ODC|ODF |ODG|ODP|ODS|ODT|OGG|PDF|PNG|POT|PPS|PPT|PPTX|RA|R AM|SWF|TAR|TIF|TIFF|WAV|WMA|WRI|XLA|XLS|XLSX|XLT|X LW|ZIP)$">
<IfModule mod_headers.c>
Header set Pragma "public"
Header append Cache-Control "public, must-revalidate, proxy-revalidate"
</IfModule>
FileETag MTime Size
<IfModule mod_headers.c>
Header set X-Powered-By "Step by Step guide to speed up your VB4 (forum only)"
</IfModule>
</FilesMatch>
# End Browser Caching/Headers

Unfortunately I don't have any benchmark comparisons for before & after cloudflare but here is my latest gtmetrix score on my site that does have cloudflare enabled.
http://gtmetrix.com/reports/www.video-game-chat.com/lcSDSldq

Also I know nothing about nginx rewrite rules atm so I can't help you with that, maybe I'll try to learn it within the coming month's.

I changed my htaccess to yours. What exactly does it do differently than mine?

[final kaoss]

What it has done is improved your score in a few areas.
http://gtmetrix.com/compare/x3r3SsIp/6uFU7ZYI

Your webpagetest score is also much better than it was previously as well now.
http://www.webpagetest.org/result/130125_G1_3JM/

Although webpagetest archive results are a bit harder to find..

If you still have that custom htaccess, something is still not allowing you to properly cache images it looks like and it could be nginx is my guess. The only stuff that should be failing is external resources.

http://www.webpagetest.org/pagespeed.php?test=130125_M6_3M0&run=1&cached=0

[AndrewSimm]

give me a min and I will turn nginx off

--------------- Added 1359089623 at 1359089623 ---------------

I ran

root@can [/etc/init.d]# httpd stop
Stopping nginx daemon: nginx.

--------------- Added 1359089969 at 1359089969 ---------------

Hm I am not sure I have a way to just stop nginx

[final kaoss]

Ok, I do know that cloudflare does support caching but I haven't had a chance to try it out without the modified htaccess. That could help you in the meantime. Remember to disable rocketloader.

[AndrewSimm]

Ok I think I fixed nginx

[final kaoss]

Yes that does seem to be a good deal better for you!

One last major thing that I strongly suggest you do, if you haven't already, is make a optimization request here:
https://www.vbulletin.com/forum/forumdisplay.php/14-Server-Configuration

While I kindof know my way around apache, the guy who answers threads there is a guru at what he does! It should definitely hellp you with memory settings and all of the other necessary hardware/mysql settings stuff.

Also, check and see if there are login issues after applying the htaccess. In my guide (https://vborg.vbsupport.ru/showthread.php?t=267588) I noticed there were for me and I posted my fix on post 3 of the guide.

[AndrewSimm]

Yes that does seem to be a good deal better for you!

One last major thing that I strongly suggest you do, if you haven't already, is make a optimization request here:
https://www.vbulletin.com/forum/forumdisplay.php/14-Server-Configuration

While I kindof know my way around apache, the guy who answers threads there is a guru at what he does! It should definitely hellp you with memory settings and all of the other necessary hardware/mysql settings stuff.

Also, check and see if there are login issues after applying the htaccess. In my guide (https://vborg.vbsupport.ru/showthread.php?t=267588) I noticed there were for me and I posted my fix on post 3 of the guide.

I can log in fine. I submitted a request. Thank for all your help. Let me know if there is anything else you can think of.

--------------- Added 1359093176 at 1359093176 ---------------

hmm yslow does agree with my expiree headers

[final kaoss]

The final thing I can suggest to you now is to try to losslessly compress your images and use css sprites. Sometimes the lossless compression can make a huge difference.



This covers the following PageSpeed Rules:

Optimize Images

If you have access to Visual Studio 2010 (grab the trial edition here (http://www.microsoft.com/visualstudio/en-us/try) which should be compatible with the addon), you can complete this step in just a few clicks using this addon
http://visualstudiogallery.msdn.microsoft.com/a56eddd3-d79b-48ac-8c8f-2db06ade77c3?SRC=VSIDE

You can also use pnggauntlet (http://pnggauntlet.com/) which will compress images as well.

This is great to use on new skins/themes and also non animated gifs for Smileys, Signatures, Photo Album & Group Images and Avatars that your forum stores on your server!

Please note that both of these methods produce lossless images, meaning that even though it uses various methods to decrease file size there is absolutely no visual loss in quality of the image.

For non-windows users, I suggest Imageoptim (http://imageoptim.com/) & Trimage (http://trimage.org/)



Step 4: Add CSS Sprites.
Not compatible with VB3

This covers the following PageSpeed Rules:

Combine images using CSS sprites

Install the addon United-Forum CSS Sprites (https://vborg.vbsupport.ru/showthread.php?t=266696) and follow all of the instructions. Can be found in the sprite_0.6.3a.zip file.

2 more things from the top of my head to consider (which I haven't had a chance to try yet) are mod_spdy & mod_pagespeed from google.

[Carnage]

Looking at it, this is one of those instances where you may just have to throw hardware at the issue. A second CPU, more ram or faster drives could help you out depending on where your bottleneck is. (From the limited info you've given us, I suspect harddrives will give the biggest win)

Before doing that, I would highly recomend looking at mariaDB as an alternative to myisam and switching fully over to nginx + php fcgi will help save some resources as well.

[final kaoss]

Well, not quite. I do agree that you may need some more hardware. Try putting the static content (js/css/html/images etc... pretty much all of your files) onto one server.

Grab a second server and use that one to only host mysql. I think your 16GB of ram should be more than enough.

Also, you may want to check out google page speed service (https://developers.google.com/speed/pagespeed/service). I've been receiving much better optimization reports (http://www.webpagetest.org/result/130126_CT_DJZ/) recently while using it!
Page Speed 1.12 Score: 92/100 Compared to 82 or so while using cloudflare instead..

[vbresults]

You don't need better hardware. The server needs to be tuned by a professional.