I will be Back - Vbseo

[Zachery]

I looked over the user tagging addon, it does run several alters on the user table, however, it is insane if its taking you 6+ hours to install it.

There is something wrong with your MySQL configuration.

[Tigga]

Originally Posted by katie hunter

Try installing this plugin as a test on a popular vb community with millions of posts, threads and members and see how long it will take https://vborg.vbsupport.ru/showthread.php?t=242733 I tried fiew others and same issue i had, 6+ hours to import or uninstall.

I just tried on a couple of sites locally out of curiosity. Neither site is *that* huge, but one has 1.5 million posts and another has 150,000 members. If I were you I would seriously look into your configuration since there's no reason your site should take 6 hours when both of my tests took less than a minute. Even if you're sites were 10x larger then you should still be able to install in less than 10 minutes.
Also, what are the results like when you try to install one of the products to your local computer? I assume you're testing things locally first and not just updating the live server anyway? Does it take you 6 hours locally too?

These tests were done locally running a Core i7 3770, 16GB RAM, w/ MySQL tables saved on a 7200RPM HDD. It's definitely NOT optimized for Apache or MySQL either.

Forum 1 running vB3 install time was 17 seconds.
100,000 threads
1,500,000 posts
11,000 members

Forum 2 running vB4 install time was 47 seconds.
36,000 threads
191,000 posts
148,000 members

[katie hunter]

Originally Posted by Zachery

I looked over the user tagging addon, it does run several alters on the user table, however, it is insane if its taking you 6+ hours to install it.

There is something wrong with your MySQL configuration.

Zachery, only DB's plugin does this.

Originally Posted by Tigga

I just tried on a couple of sites locally out of curiosity. Neither site is *that* huge, but one has 1.5 million posts and another has 150,000 members. If I were you I would seriously look into your configuration since there's no reason your site should take 6 hours when both of my tests took less than a minute. Even if you're sites were 10x larger then you should still be able to install in less than 10 minutes.
Also, what are the results like when you try to install one of the products to your local computer? I assume you're testing things locally first and not just updating the live server anyway? Does it take you 6 hours locally too?

These tests were done locally running a Core i7 3770, 16GB RAM, w/ MySQL tables saved on a 7200RPM HDD. It's definitely NOT optimized for Apache or MySQL either.

Forum 1 running vB3 install time was 17 seconds.
100,000 threads
1,500,000 posts
11,000 members

Forum 2 running vB4 install time was 47 seconds.
36,000 threads
191,000 posts
148,000 members

I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

[Necrovaris]

Originally Posted by katie hunter

I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

Which as many people have been saying, if thats the case theres something *horribly* wrong with your setup.

Id be willing to prove it aswell, hook me up with a copy of your vb install and database, and you can install the addon on one of my servers, I bet it would be done in minutes.

[DragonByte Tech]

Originally Posted by katie hunter

Fillip, I've quoted what you said on page 1, you said exactly this

Yes I did. I've never denied that we've had complaints from large forums as a result of the alters on the "post" and "user" tables. Nobody has ever complained about a 6+ hour lock, that is an issue on your server and your server alone.

A large forum is going to complain if it takes more than 30 seconds to install (which is the timeout value of PHP scripts on most servers), unless their server is setup to allow for PHP scripts to extend their execution time infinitely.

Please stop arguing the point with people who know more about this than you.
I'm not saying this to be offensive, I wouldn't argue with a chemist about the effects of certain drugs just because I at one point read a Wikipedia page. I accept that this person is more knowledgeable than me in the field of chemistry.

Just for fun, I'm going to show you how fast our database server can run an alter on a DB table that has 9 million rows in it.
The specs of the DB server are as follows:
CPU: 3.3Ghz e3-1230-V2 Ivy Bridge with HT
RAM: 8GB DDR3
HDD: 60GB Intel Solid State Drive 520 Series
OS: CentOS 6.5 x64

MariaDB [finalfan_forum]> SELECT COUNT(*) FROM dbtech_vbactivity_pointslog;
+----------+
| COUNT(*) |
+----------+
|  9051708 |
+----------+
1 row in set (0.00 sec)

As you can see, it has 9 million, 51 thousand, 7 hundred and 8 rows. This is approximately 6 times as many rows as you have in your "user" table.

A clean install of Advanced User Tagging (latest version at the time of writing) is going to run 9 alters in total against the "user" table (spread across 3 different installation steps). This modification does not alter the "post" table in any way, shape or form.

This is the result:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog ADD testcolumn INT(10) UNSIGNED NOT NULL DEFAULT '0';
Query OK, 9051708 rows affected (38.38 sec)            
Records: 9051708  Duplicates: 0  Warnings: 0

In other words, 1 out of 9 alters takes 38.38 seconds on a machine that is empirically slower than yours.

Extrapolating this further, 9 out of 9 alters would take approximately 345.42 seconds, or 5.76 minutes.

What about uninstallation, you ask?

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog DROP testcolumn;                                     
Query OK, 9051708 rows affected (35.60 sec)            
Records: 9051708  Duplicates: 0  Warnings: 0

1 out of 9 uninstallation steps takes 35.60 seconds.

Extrapolating this further, 9 out of 9 uninstallation steps would take 320.4 seconds or 5.34 minutes.

Even if we double, triple, quadruple, [...] the query time to account for the delay suffered when running this query via PHP as opposed to the command line, this does not come anywhere NEAR the 6+ hour time your server is experiencing.

The forum in question was http://www.finalfantasyforums.net/ which has over 1 million posts at the time of writing yet did not experience any issues when installing any of our modifications that make numerous alters to the "post" table.
(We host this forum, and the database server the forum runs on is the machine whose specs I listed above.)

I'm very much going to enjoy hearing your next round of excuses


Fillip

[final kaoss]

Good god you need to tell your final fantasy client to configure the copyright mod better lol, that footer is full of backlinks.

[Tigga]

Originally Posted by katie hunter

I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

I doubt many others make as many table alterations as his, simply because they're not necessary for that modification or because the author may not realize that altering a vB table would be better than trying to keep up with separate tables. I fully agree that it's best to avoid altering vB tables when you can, but it's often not the best practice if you want an add-on to run smoothly and without taking up any extra server resources. I'd much rather have it shut down my forum for 10 minutes during the install than to have it running extra queries during every page load after that. A 6 hour install time is obviously different, but apparently you're the only one that's experiencing times that are anywhere near that extreme, so I'd say it sounds more like DB has things balanced correctly and it's your server configuration that is suspect.

[DragonByte Tech]

Originally Posted by final kaoss

Good god you need to tell your final fantasy client to configure the copyright mod better lol, that footer is full of backlinks.

That's kind of the idea

They are fine with having it like that, and it gives us more traffic, so everybody's happy


Fillip

[katie hunter]

Originally Posted by DragonByte Tech

Yes I did. I've never denied that we've had complaints from large forums as a result of the alters on the "post" and "user" tables. Nobody has ever complained about a 6+ hour lock, that is an issue on your server and your server alone.

A large forum is going to complain if it takes more than 30 seconds to install (which is the timeout value of PHP scripts on most servers), unless their server is setup to allow for PHP scripts to extend their execution time infinitely.

Please stop arguing the point with people who know more about this than you.
I'm not saying this to be offensive, I wouldn't argue with a chemist about the effects of certain drugs just because I at one point read a Wikipedia page. I accept that this person is more knowledgeable than me in the field of chemistry.

Just for fun, I'm going to show you how fast our database server can run an alter on a DB table that has 9 million rows in it.
The specs of the DB server are as follows:
CPU: 3.3Ghz e3-1230-V2 Ivy Bridge with HT
RAM: 8GB DDR3
HDD: 60GB Intel Solid State Drive 520 Series
OS: CentOS 6.5 x64

MariaDB [finalfan_forum]> SELECT COUNT(*) FROM dbtech_vbactivity_pointslog;
+----------+
| COUNT(*) |
+----------+
|  9051708 |
+----------+
1 row in set (0.00 sec)

As you can see, it has 9 million, 51 thousand, 7 hundred and 8 rows. This is approximately 6 times as many rows as you have in your "user" table.

A clean install of Advanced User Tagging (latest version at the time of writing) is going to run 9 alters in total against the "user" table (spread across 3 different installation steps). This modification does not alter the "post" table in any way, shape or form.

This is the result:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog ADD testcolumn INT(10) UNSIGNED NOT NULL DEFAULT '0';
Query OK, 9051708 rows affected (38.38 sec)            
Records: 9051708  Duplicates: 0  Warnings: 0

In other words, 1 out of 9 alters takes 38.38 seconds on a machine that is empirically slower than yours.

Extrapolating this further, 9 out of 9 alters would take approximately 345.42 seconds, or 5.76 minutes.

What about uninstallation, you ask?

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog DROP testcolumn;                                     
Query OK, 9051708 rows affected (35.60 sec)            
Records: 9051708  Duplicates: 0  Warnings: 0

1 out of 9 uninstallation steps takes 35.60 seconds.

Extrapolating this further, 9 out of 9 uninstallation steps would take 320.4 seconds or 5.34 minutes.

Even if we double, triple, quadruple, [...] the query time to account for the delay suffered when running this query via PHP as opposed to the command line, this does not come anywhere NEAR the 6+ hour time your server is experiencing.

The forum in question was http://www.finalfantasyforums.net/ which has over 1 million posts at the time of writing yet did not experience any issues when installing any of our modifications that make numerous alters to the "post" table.
(We host this forum, and the database server the forum runs on is the machine whose specs I listed above.)

I'm very much going to enjoy hearing your next round of excuses

Fillip

Who said excuses. I know what i encountered. You want to tell me that only your plugins are causing issues on my forum when install or uninstall and all the other plugins by other members doesn't have the same affect ? Because that is what i noticed and saw (only yours), that is why i said i never try to install any because of this issue, it is kinda scary actually not knowing when the task will be finished and to wait that long.

My server admin has access to this topic and there is a pending ticket, i am sure if he noticed something wrong, he will let me know.

Originally Posted by Tigga

I doubt many others make as many table alterations as his, simply because they're not necessary for that modification or because the author may not realize that altering a vB table would be better than trying to keep up with separate tables. I fully agree that it's best to avoid altering vB tables when you can, but it's often not the best practice if you want an add-on to run smoothly and without taking up any extra server resources. I'd much rather have it shut down my forum for 10 minutes during the install than to have it running extra queries during every page load after that. A 6 hour install time is obviously different, but apparently you're the only one that's experiencing times that are anywhere near that extreme, so I'd say it sounds more like DB has things balanced correctly and it's your server configuration that is suspect.

I always have my forum turned off when installing any plugin.

[final kaoss]

Send him over here and get him posting... it's probably about time he voiced in his opinion on the matter.