Board Optimization - Dynamically Linked Source - Speed Up Your Multiple Site Network & Upgrades

For the purposes of this documentation, "Network" refers to a group of forums on a single server or cluster of servers.

When 3.7.1 PL2 was released, I posted over at vbulletin.com lamenting the fact that I had 15 upgrades to perform and how it would be nice to have a multiple site license to lighten the burden of downloading each install separately. In the end, I spent much more time coming up with this system.

Dynamically Linked Source or DLS allows operators of two or more forums on the same server or cluster, for all intents and purposes, to use one set of source code instead of multiple sets. By using one set of source code, Op code caching is much more efficient as only one copy of the source is cached. This greatly reduces the amount of memory used caching the source code, and also makes it more efficient. It will lead to less fragmentation for systems using APC, XCache, eAccelerator, or other such methods of caching Op code.

The method uses symbolic links to a central repository of the source code. Therefore, upgrades to all sites on the network can be done quickly by just replacing the source. For patch level releases, this means the entire network can be patched with one upload. Upgrades to a new version can be done this way, or a new repository can be created and each site can be upgraded one at a time.

The issue of licensing has also been addressed. Once the product file is installed, and assuming the installation instructions were followed, each installation will report the proper license key when salting cookies, or reporting back to Jelsoft as Vbulletin does from time to time (mostly in the AdminCP).

I contacted the development team at Jelsoft and discussed this method before releasing it, and got the OK from Mike. I was initially concerned that it may break licensing or perhaps give away too much of the license reporting methodology, but now that I look back, it really does not do either.

In tests on a rather large network that contains seven forums with about 7 million posts, hundreds of thousands of registered users, and uses three load balanced servers the load has been reduced by almost 40%. You can see in the graph attached to this thread for the particulars.

I have tried to make the readme as clear as possible, but honestly that was never one of my strong points. I cannot emphasize more that before you implement this method, TEST it first in your sandbox. Also, make sure you backup your software and database before you use this.

I also have included a PDF that explains what is happening in greater detail.

Updates:

8/20/08 - This will work with the latest version of VBSEO (3.2.0 at this time). Add all the files to the DLS except the config file, and run the php-clone.php script.

This product was developed for Andy R from Social Knowledge and released here for others to enjoy.


Please don't forget to click install as I have worked quite a while on this.

[Jafo232]

Reserved...

[Zacarias]

This is very interesting. I'll be testing this one.

[GrendelKhan{TSU]

awesome. exactly what I need. will test. thank you!!


ps. er... how do I sandbox test this for multiple boards? do I ahve to set up a multi-board test as well?

[nirvana43]

Installed and rated! thanks a million man.

[Jafo232]

Originally Posted by GrendelKhan{TSU

awesome. exactly what I need. will test. thank you!!


ps. er... how do I sandbox test this for multiple boards? do I ahve to set up a multi-board test as well?

Well, you don't HAVE to setup multiple boards in the sandbox, but if you want to test how it works with multiple boards (which is the whole point) then yes. But if you want to see how it works, one will be enough. Once you get it working on one site, you should not have problems getting it to work on multiple sites.

Just remember, BACK UP EVERYTHING! The php-clone.php script DELETES your forum source code files and then replaces them with symbolic links. Should you configure it wrong, you could find yourself with no forum software. A quick backup of the source files will correct that quickly.

I also recommend backing up the database, not that this product/method does anything to the database, it is just for prudence sake...

[AzzidReign]

Wow, this is a great idea. I'm going to check this out once I get some free time.

[Reeve of shinra]

This looks great and its going to be a blessing for those running multiple forums. I assume each sites keeps its own DB? How are mods and plugins handled? I assume they are excluded?

[Jafo232]

Originally Posted by Reeve of shinra

This looks great and its going to be a blessing for those running multiple forums. I assume each sites keeps its own DB? How are mods and plugins handled? I assume they are excluded?

Yes, each site still keeps its own DB, and mods/plugins are handled the same way as they always were or you can include them in the DLS and make them available to the entire network.

You can link any file just by adding it to the DLS source and running the php-clone.php script.

[djr]

*VERY* interesting and I love the out-of-the-box thinking. Truly impressed. Do you know whether this will impact vbSEO? Would it be possible to also include vbSEO in the DLS or isn't that necessary?