vB Accelerator

[Vitaly]

ported & significantly improved vb 3.8 branch (https://vborg.vbsupport.ru/showthread.php?t=207566).

This mod is suited for medium and big boards. It reduces server load, caused by thumnails and big attachments. Includes significant recommendations for server tuning, to speedup pages loading.

what's the problem with?
In original vB all thumbnails a downloaded via php. So, if you page contains 10-20 attached images, then each page php request will be followed by 10-20 thumbnails php requests. That's very bad.
When attachments body transfered via php, that's much more waisteful, than direct transfer of static file. Especially for big files.
Browser does lots of additional requests to static file, to check if modified
JS/CSS not compressedwhat this mod does:
All thumbnails will have DIRECT links (served as static files). Much lower reply latency and server load.
If you have nginx (http://nginx.net/) webserver, you php-fcgi will not participate in file transfer any more. It will reply with X-Accel-Redirect header. Then nginx will proceed attachment as static file.
No more problems with multiple downloads of 10-mb files.
No needs to restrict attachments and full-size images for guests and search bots.
Static files are properly cached/compressed after tuninghow to install:
Make sure, attachments are stored on disk, NOT in database.
Make sure, that thumbnails are in web-accessible area. If not - reconfigure your web-server first.
Check manually, that you can download any .thumb file via browser.
!!! Tune cache/compression settings for static files (see example from next post)
Import product XML & tune settings.
EnjoyThis mod is developped here: http://github.com/rcdesign/vb-accelerator . Patches are welcome.

history:

0.9
- fixed path for duplicated attachments

0.8
- fixed back timestamp parameter & substitutions for XML output
- added conversion for assets.php thumbnails (in attachments manager)

0.7
- ported to vb4
- added basic CDN support for thumbnails

[Vitaly]

Nginx config sample

# Modified gzip settings: added CSS/JS,
# but completely disabled for broken browsers.
gzip_types text/plain text/css application/x-javascript text/xml text/javascript;
gzip_disable "MSIE [1-6].(?!.*SV1)";


# globally disable external access to attachments, but enable for X-Accel-Redirect
location /uploads {
internal;
}
# enable thumbnails direct access, but nothing else!
location ~* /uploads/(.*)\.thumb$ {
expires 24h;
}


# Expires for static files.
location /images/ {
expires 24h;
}
location /clientscript/ {
expires 24h;
}
location /custom { # All at once: profile pics, avatars, group images
expires 24h;
}


Apache config example

TBD :) . Please, help to fill.

[funmasti]

Thanks... anyone tried it?

[gwerzal]

This looks good. thanks for sharing.

[Vitaly]

Updated mod to catch XML output & timestamp issues.

[TeknoSounds]

Will this work along side vbOptimize and vB4: Supercharged? Are there conflicts? Duplicated features?

[ChopSuey]

Will this work along side vbOptimize and vB4: Supercharged? Are there conflicts? Duplicated features?

vBOptimize is more of caching, vB4 supercharges is like "Store CSS As files" option but a little better. I don't see any conflicts.

[Darkimmortal]

Oh cool, this looks like an improved version of my 'Attachment Optimiser' in vB4 SuperCharged - installed :)

[Dr.osamA]

Thanks
installed

but i am not sour if it is working

anyone tried it?

waiting for tests

[Vitaly]

Oh cool, this looks like an improved version of my 'Attachment Optimiser' in vB4 SuperCharged - installed :)

In fact, on the second page load, other feature doesn't make sence, if you set long expire for static content :) . You can check with firebug NET bookmark.

Optimizing the first page load is potentially interesting, but price in your case is very high - big server load and lots of possible conflicts.

[kawe]

This is .htaccess on Nginx ?

# Modified gzip settings: added CSS/JS,
# but completely disabled for broken browsers.
gzip_types text/plain text/css application/x-javascript text/xml text/javascript;
gzip_disable "MSIE [1-6].(?!.*SV1)";


# globally disable external access to attachments, but enable for X-Accel-Redirect
location /uploads {
internal;
}
# enable thumbnails direct access, but nothing else!
location ~* /uploads/(.*)\.thumb$ {
expires 24h;
}


# Expires for static files.
location /images/ {
expires 24h;
}
location /clientscript/ {
expires 24h;
}
location /custom { # All at once: profile pics, avatars, group images
expires 24h;
}

And about " path to attachments "
is full path like : /home/www/html/sites.com/attachment
or
just /attachment/

[Vitaly]

This is .htaccess on Nginx ?

Nginx doesn't support .htaccess. That's pаrt of config file. Please, read nginx documentation for details.

[kawe]

Nginx doesn't support .htaccess. That's pаrt of config file. Please, read nginx documentation for details.

yeah i add this code to /etc/nginx/sites-enable/mydomain.com :D
under my vBseo config :) its right ?

[Vitaly]

Will this work along side vbOptimize and vB4: Supercharged? Are there conflicts? Duplicated features?

vbOptimize do different things. It can make sence, if you have DB on separate server. Or if you setup many dirty-written mods :) . No conflicts. If you have local DB, then built-in query cache do most things for you.

Supercharged have some interesting ideas, but not balanced, IMHO. The same result can be acheived with much less efforts & server load :)

vb Accelerator - if you dont use attachments, skip it :) . But set "not expire" headers for static content. It really worth to do.

[Vitaly]

yeah i add this code to /etc/nginx/sites-enable/mydomain.com :D
under my vBseo config :) its right ?

Gzip options can be in other place. Look there they are in your config, compare difference and fix.

Other rewrites should be BEFORE vbseo.

[Fenriz]

Can I use Mod Version: 0.8 with vbulletin 3.8.5?

[Vitaly]

NO. You should use version from this topic: https://vborg.vbsupport.ru/showthread.php?t=207566

[tupique]

Installed, but downloaded from other forum by accident. However, I don't see that the URL is changing. I still see attachment.php as part of the URL. Am I missing something here?

[Vitaly]

You should check thumbnails path, but not full-size attachments links.

If you have problems, please provide more detailed information. For example - incorrect thumbnails URLs

[tupique]

ahh I see.. so this mod is used to change the thumbnails URL only, not the full image? I did simple checking (disabling and enabling this mod), and I saw what you meant. Thanks a lot!

Another question, the URL in my forum is like this:

http://<domain hidden>/img/1/1.thumb?d=1276962745

Could you remove the query string parameter? It ruins the purpose of image caching, since the parameter value always changing while the image stays the same.

[Vitaly]

so this mod is used to change the thumbnails URL only, not the full image?

The goal of this mod is to reduce server load. Direct thumb links affect load. Full attach links - not.

There can be 20 thumbs on thread page. But not 20 fullsize images, downloaded at once.

http://<domain hidden>/img/1/1.thumb?d=1276962745

Could you remove the query string parameter? It ruins the purpose of image caching, since the parameter value always changing while the image stays the same.

This parameter doesn't affect cacheing. It's fixed for each thumbnail.

[tupique]

great! thanks!

[tupique]

Could you maybe do the same for image.php (to display user's avatar)? It's hard to cache image served by PHP script.

[Vitaly]

It's already done in vbulletin settings. Please, read vb manual. This mod is NOT buggy, and works properly. Really.

[ssslippy]

Do attachments themselves need to be in a public accessible area or just the thumbnails?

[Vitaly]

Just the thumbnails

[Xencored]

Fact my thumbs seem tons faster to load thanks!!

now Vitaly could you explain this part please

"CDN list
Enter up to 4 mirror domains, to load local images faster. For example:"

Thanks!

Ps. how do i know if i have a NGINX websever lol sorry :x

[Vitaly]

You'd better to read yahoo website optimization manuals.

In 2 words:

1. Browser allows only 2 parallel connections to each domain, and 8 total.
2. If you do mirrors for your images, it can download up to 8 images simultaniously
3. It's better to keep mirrors on separate domain, without cookies, to speed up requests

That can make some sence, ONLY if you have tons of thumbnails on each single page.

I did this feature for fun, and didn't meashured effect yet. Anyway, it's not as significant, as (direct links + proper cache headers for static files).

Ps. how do i know if i have a NGINX websever lol sorry :xIf you ask such question, then 99% you don't have nginx :)

[Xencored]

You'd better to read yahoo website optimization manuals.

In 2 words:

1. Browser allows only 2 parallel connections to each domain
2. If you do mirrors for you images, it can download up to 8 images simultaniously
3. It's better to keep mirrors no separate domain, without cookies, to speed up requests

That can make some sence, ONLY if you have tons of thumbnails on each single page.

I did this feature for fun, and didn't meashured effect yet. Anyway, it's not as significant, as (direct links + proper cache headers for static files).

Thanks for that i dont use any mirrors so i can leave that blank


If you ask such question, then 99% you don't have nginx :)

Guess not than :)

Thanks mate the speed on pages like >>This (http://www.myanimeisland.com/threads/290-Most-Accurate-Cosplays)<< is tons better

Nomination!

[Vitaly]

Thanks mate the speed on pages like >>This (http://www.myanimeisland.com/threads/290-Most-Accurate-Cosplays)<< is tons better

You also have to tune apache config. Remove ETAG headers, and add Expires (in next 7 days) headers instead for all static files.

[Xencored]

You also have to tune apache config. Remove ETAG headers, and add Expires (in next 7 days) headers instead for all static files.

Oh but it seems to have speeded it up with out that
so if i work out how to do above it will be even faster?:D

[doraj]

Hello Vitaly,

in the AdminCP Options, at "Path to attachments", need to insert the patch of the thumb right?

But it is the same of the attachments? If not, How can I find the correct path? I remember to have setup the attachments stored on disk, but I don't rememeber a specific path where are store my thumb.

All my attachments are in : "forum/attachments"

Thank you

[Vitaly]

Try /forum/attachments or /attachments

It's easy to check:
- open page source
- check generated thumbnal paths
- if not correct - play with setting to fix difference.

Of cause, you should check, that thumbnails can be downloaded via www (that's mentioned in installetion steps).

[Vitaly]

Oh but it seems to have speeded it up with out that
so if i work out how to do above it will be even faster?:D

Sorry to disappoint, but I have no apache. So, I can say WHAT should be done, but not HOW. Try to ask your admin or google this question :) . Don't forget to share result, if you have some.

[ImmortalForums]

Hmm have an odd issue. I have attachments on a subdomain along with all the url rewrites working. The attachment thumbnails show however when you click on the attachment image they do not load in the lightbox. Any advice?

I do run imagemagick of that has any effect.

[Vitaly]

Do those work:

- if you switch off lightbox
- if you switch off this mod

?

The other way to check is to install firebug addon for firefox, and check what happens in network tab when image fails to load.

[ImmortalForums]

Turns out I am getting 404 errors on the lightbox and if I load the attachment directly. If I disable this mod the attachments work fine and the thumbs still work.

So it seems something from this mod is breaking the attachments themselves.

[Vitaly]

Can you check with firebug, which URL failed for lightbox?

[ImmortalForums]

Played with it some more it turns out its the X-Accel-Redirect. Updated my NGINX just to make sure it wasnt a bug.


Failing URL is
http://immortal-guild.net/attachment.php?attachmentid=9021&d=1271597314

[Vitaly]

This mod doesn't affect fullsize attachments, if you turn off "nginx acceleration" option.

If problem caused by this option, then absolute disk path can be wrong, or some rare nginx limitation for X-Accel-Redirect (see docs).

[ImmortalForums]

This mod doesn't affect fullsize attachments, if you turn off "nginx acceleration" option.

If problem caused by this option, then absolute disk path can be wrong, or some rare nginx limitation for X-Accel-Redirect (see docs).

I can not figure out for the life of me the issue. I know the path is correct or the attachments wouldn't load in the first place. I checked the nginx docs there isnt anything I can really configure http://wiki.nginx.org/NginxXSendfile. Eh I will live without the feature.

[Vitaly]

What's in nginx error logs, when option is on?

[ImmortalForums]

Ok here is your error

2010/07/27 21:33:18 [error] 565#0: *17 open() "/var/www/immortalguild/html/uploads/2/2/6/2/9319.attach" failed (2: No such file or directory), client: 68.194.193.123, server: immortal-guild.net, request: "GET /attachment.php?attachmentid=9334&d=1279589679 HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "immortal-guild.net", referrer: "http://immortal-guild.net/threads/49537-Slippy"

My path to attachments is /uploads

CDN is at http://attachment.immortal-guild.net

The physical directory is /var/www/immortalguild/attachment/uploads
The physical web directory is /var/www/immortalguild/html

So it seems your mod isnt using the CDN URL with X-Accel-Redirect. Hopefully you can fix this. :-)

[Vitaly]

CDN is not used for X-Accel-Redirect, yes. It's for thumbnails only. It's better to keep attachments directory in forum root, and change nginx config for attachments domain (root path). Make mod work without CDN first, then play with domain aliases.

I'll check, what can be improved, but not right now.

[delmarva]

Thank you Vitaly!

[Taurus1]

Hi there. Will this work with LightSpeed?

[Taurus1]

Well, I installed it. Is there a clear way for me to check if it is working?

Thanks.

[sivaganeshk]

Hi, How to use Expire header functions ?

[MmS1]

hello i tried to install Nagns but i can't

i stuck here
/usr/local/nginx/sbin/nginx -t
[emerg]: invalid event type "rtsig" in /usr/local/nginx/conf/nginx.conf:11
configuration file /usr/local/nginx/conf/nginx.conf test failed
root@c134 [/usr]# /usr/local/nginx/sbin/nginx
[emerg]: invalid event type "rtsig" in /usr/local/nginx/conf/nginx.conf:11
Manual-Install-Nginx
http://www.vbulletin.com/forum/showthread.php?318923-Manual-Install-Nginx-with-Cpanel-Apache-in-proxy-mode-(English-Espa%F1ol)

so can u help me

[punchbowl]

Do attachments have to be in a publicly available area for this to work e.g.

/srv/www/domain.com/public_html/attachments

or will it work at

/srv/www/domain.com/attachments

?

[CMSTemplateZ]

Good work :) ive got a board that is slowly growing bigger, this is good to know something like this is available.

[Vitaly]

Do attachments have to be in a publicly available area for this to work e.g.
?

thumbnails should be available via www

[punchbowl]

Sorry for being stupid Vitaly but I see no separate setting for storing attachment thumbnails in one place and attachments in another? Will I have to move the attachment directory into www or am I missing something?

Am I right in saying that having attachment in www means that private attachments will be public?

Thanks

[Vitaly]

See example from second post https://vborg.vbsupport.ru/showpost.php?p=2051904&postcount=2 , how to tune nginx. I don't understand your problem.

[punchbowl]

Sorry I'm new to nginx. I didn't understand the "internal" directive. Wow nginx just gets better and better. Cheers and thank you for your patience!

[punchbowl]

nope - can't get it working, when I enable I get no images loading. Disabling makes it ok.

I have attachments @ /srv/www/domain.com/public_html/attach

I have domain.com thus:

server {
listen 80;
client_max_body_size 2M;
server_name www.domain.com domain.com;
access_log /srv/www/domain.com/logs/access.log;
error_log /srv/www/domain.com/logs/error.log;

location / {
root /srv/www/domain.com/public_html;
index index.php index.html index.htm;
}

# globally disable external access to attachments, but enable for X-Accel-Redirect
location /attach {
internal;
}
# enable thumbnails direct access, but nothing else!
location ~* /attach/(.*)\.thumb$ {
expires 24h;
}


location ~ \.php$ {
include /etc/nginx/fastcgi_params;
fastcgi_pass 127.0.0.1:9000;
fastcgi_index index.php;
fastcgi_param SCRIPT_FILENAME /srv/www/domain.com/public_html$fastcgi_script_name;
fastcgi_connect_timeout 60;
fastcgi_send_timeout 180;
fastcgi_read_timeout 180;
fastcgi_buffer_size 128k;
fastcgi_buffers 4 256k;
fastcgi_busy_buffers_size 256k;
fastcgi_temp_file_write_size 256k;
fastcgi_intercept_errors on;
}
}

in admincp I have path to attachements: /attach

cdn: blank

and

Enable large downloads acceleration: ticked yes

edit: I get a 404 for http://www.domain.com/attach/9/226.thumb

[acha3ir.net]

Thank you for the excellent work

[ImmortalForums]

This breaks images inside quote boxes with just the cdn enabled.

[Vitaly]

Please, provide more details.

[ImmortalForums]

When using only the cdn feature and having accel off and someone quotes an image instead of showing the image it just has a link.

[Vitaly]

Does it work correct when this mod is off? If yes, please give me example of bbcode & html source

[ImmortalForums]

Rebuilt the post cache and the quotes show attachments. Now if this only worked on the CMS.

[shershen08]

does it work with 4.1.12 version?

[shershen08]

does it work with 4.1.12 version?
it works but there are some problems, see my post in vbulletin.com/forum -
https://www.vbulletin.com/forum/showthread.php/402168-Attachents-thumbnails-point-to-wrong-place-after-installing-vB-Accelerator

[majjed2008]

is it work with vb 4.2 ?

[BeoRski]

is it work with vb 4.2 ?
It seems to be working fine on my site...

[fxdigi-cash]

Thanks for the great mod!

it works on vb4.2.1 fine

[webmaster74]

the last time the dev was online is 4 years ago. This mod was released 8 years ago. How do we know if it is still safe to install ?

[Max Taxable]

the last time the dev was online is 4 years ago. This mod was released 8 years ago. How do we know if it is still safe to install ?You don't know that ANY mod is safe to install.

[webmaster74]

You don't know that ANY mod is safe to install.

you are indeed right, but in principle, a recent mod is less of a risk than an old and non-updated one.

[MarkFL]

you are indeed right, but in principle, a recent mod is less of a risk than an old and non-updated one.

Whenever I have interest in using a new (that I've not used before) product, I always install on a test installation first, and put it through its paces there, and work out all issues if they exist before I consider installing on a live site.