vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Community Lounge (https://vborg.vbsupport.ru/forumdisplay.php?f=13)
-   -   I will be Back - Vbseo (https://vborg.vbsupport.ru/showthread.php?t=311520)

Zachery 05-22-2014 04:02 PM

I looked over the user tagging addon, it does run several alters on the user table, however, it is insane if its taking you 6+ hours to install it.

There is something wrong with your MySQL configuration.

Tigga 05-22-2014 04:15 PM

Quote:

Originally Posted by katie hunter (Post 2498902)
Try installing this plugin as a test on a popular vb community with millions of posts, threads and members and see how long it will take https://vborg.vbsupport.ru/showthread.php?t=242733 I tried fiew others and same issue i had, 6+ hours to import or uninstall.

I just tried on a couple of sites locally out of curiosity. Neither site is *that* huge, but one has 1.5 million posts and another has 150,000 members. If I were you I would seriously look into your configuration since there's no reason your site should take 6 hours when both of my tests took less than a minute. Even if you're sites were 10x larger then you should still be able to install in less than 10 minutes.
Also, what are the results like when you try to install one of the products to your local computer? I assume you're testing things locally first and not just updating the live server anyway? Does it take you 6 hours locally too?

These tests were done locally running a Core i7 3770, 16GB RAM, w/ MySQL tables saved on a 7200RPM HDD. It's definitely NOT optimized for Apache or MySQL either.

Forum 1 running vB3 install time was 17 seconds.
100,000 threads
1,500,000 posts
11,000 members

Forum 2 running vB4 install time was 47 seconds.
36,000 threads
191,000 posts
148,000 members

katie hunter 05-22-2014 04:25 PM

Quote:

Originally Posted by Zachery (Post 2498958)
I looked over the user tagging addon, it does run several alters on the user table, however, it is insane if its taking you 6+ hours to install it.

There is something wrong with your MySQL configuration.

Zachery, only DB's plugin does this.

Quote:

Originally Posted by Tigga (Post 2498963)
I just tried on a couple of sites locally out of curiosity. Neither site is *that* huge, but one has 1.5 million posts and another has 150,000 members. If I were you I would seriously look into your configuration since there's no reason your site should take 6 hours when both of my tests took less than a minute. Even if you're sites were 10x larger then you should still be able to install in less than 10 minutes.
Also, what are the results like when you try to install one of the products to your local computer? I assume you're testing things locally first and not just updating the live server anyway? Does it take you 6 hours locally too?

These tests were done locally running a Core i7 3770, 16GB RAM, w/ MySQL tables saved on a 7200RPM HDD. It's definitely NOT optimized for Apache or MySQL either.

Forum 1 running vB3 install time was 17 seconds.
100,000 threads
1,500,000 posts
11,000 members

Forum 2 running vB4 install time was 47 seconds.
36,000 threads
191,000 posts
148,000 members

I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

Necrovaris 05-22-2014 04:34 PM

Quote:

Originally Posted by katie hunter (Post 2498965)
I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

Which as many people have been saying, if thats the case theres something *horribly* wrong with your setup.

Id be willing to prove it aswell, hook me up with a copy of your vb install and database, and you can install the addon on one of my servers, I bet it would be done in minutes.

DragonByte Tech 05-22-2014 04:34 PM

Quote:

Originally Posted by katie hunter (Post 2498902)
Fillip, I've quoted what you said on page 1, you said exactly this

Yes I did. I've never denied that we've had complaints from large forums as a result of the alters on the "post" and "user" tables. Nobody has ever complained about a 6+ hour lock, that is an issue on your server and your server alone.

A large forum is going to complain if it takes more than 30 seconds to install (which is the timeout value of PHP scripts on most servers), unless their server is setup to allow for PHP scripts to extend their execution time infinitely.

Please stop arguing the point with people who know more about this than you.
I'm not saying this to be offensive, I wouldn't argue with a chemist about the effects of certain drugs just because I at one point read a Wikipedia page. I accept that this person is more knowledgeable than me in the field of chemistry.

Just for fun, I'm going to show you how fast our database server can run an alter on a DB table that has 9 million rows in it.
The specs of the DB server are as follows:
CPU: 3.3Ghz e3-1230-V2 Ivy Bridge with HT
RAM: 8GB DDR3
HDD: 60GB Intel Solid State Drive 520 Series
OS: CentOS 6.5 x64

Code:

MariaDB [finalfan_forum]> SELECT COUNT(*) FROM dbtech_vbactivity_pointslog;
+----------+
| COUNT(*) |
+----------+
|  9051708 |
+----------+
1 row in set (0.00 sec)

As you can see, it has 9 million, 51 thousand, 7 hundred and 8 rows. This is approximately 6 times as many rows as you have in your "user" table.

A clean install of Advanced User Tagging (latest version at the time of writing) is going to run 9 alters in total against the "user" table (spread across 3 different installation steps). This modification does not alter the "post" table in any way, shape or form.

This is the result:
Code:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog ADD testcolumn INT(10) UNSIGNED NOT NULL DEFAULT '0';
Query OK, 9051708 rows affected (38.38 sec)           
Records: 9051708  Duplicates: 0  Warnings: 0

In other words, 1 out of 9 alters takes 38.38 seconds on a machine that is empirically slower than yours.

Extrapolating this further, 9 out of 9 alters would take approximately 345.42 seconds, or 5.76 minutes.

What about uninstallation, you ask?
Code:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog DROP testcolumn;                                   
Query OK, 9051708 rows affected (35.60 sec)           
Records: 9051708  Duplicates: 0  Warnings: 0

1 out of 9 uninstallation steps takes 35.60 seconds.

Extrapolating this further, 9 out of 9 uninstallation steps would take 320.4 seconds or 5.34 minutes.

Even if we double, triple, quadruple, [...] the query time to account for the delay suffered when running this query via PHP as opposed to the command line, this does not come anywhere NEAR the 6+ hour time your server is experiencing.

The forum in question was http://www.finalfantasyforums.net/ which has over 1 million posts at the time of writing yet did not experience any issues when installing any of our modifications that make numerous alters to the "post" table.
(We host this forum, and the database server the forum runs on is the machine whose specs I listed above.)

I'm very much going to enjoy hearing your next round of excuses :)


Fillip

final kaoss 05-22-2014 04:41 PM

Good god you need to tell your final fantasy client to configure the copyright mod better lol, that footer is full of backlinks.

Tigga 05-22-2014 04:50 PM

Quote:

Originally Posted by katie hunter (Post 2498965)
I have no issue with any plugin, only DB's, that is what i said on page 1 from the start, that i stay away from his plugins because of this issue which puts my site down until the entire process finishes.

I doubt many others make as many table alterations as his, simply because they're not necessary for that modification or because the author may not realize that altering a vB table would be better than trying to keep up with separate tables. I fully agree that it's best to avoid altering vB tables when you can, but it's often not the best practice if you want an add-on to run smoothly and without taking up any extra server resources. I'd much rather have it shut down my forum for 10 minutes during the install than to have it running extra queries during every page load after that. A 6 hour install time is obviously different, but apparently you're the only one that's experiencing times that are anywhere near that extreme, so I'd say it sounds more like DB has things balanced correctly and it's your server configuration that is suspect.

DragonByte Tech 05-22-2014 04:57 PM

Quote:

Originally Posted by final kaoss (Post 2498969)
Good god you need to tell your final fantasy client to configure the copyright mod better lol, that footer is full of backlinks.

That's kind of the idea :p

They are fine with having it like that, and it gives us more traffic, so everybody's happy :)


Fillip

katie hunter 05-22-2014 05:01 PM

Quote:

Originally Posted by DragonByte Tech (Post 2498967)
Yes I did. I've never denied that we've had complaints from large forums as a result of the alters on the "post" and "user" tables. Nobody has ever complained about a 6+ hour lock, that is an issue on your server and your server alone.

A large forum is going to complain if it takes more than 30 seconds to install (which is the timeout value of PHP scripts on most servers), unless their server is setup to allow for PHP scripts to extend their execution time infinitely.

Please stop arguing the point with people who know more about this than you.
I'm not saying this to be offensive, I wouldn't argue with a chemist about the effects of certain drugs just because I at one point read a Wikipedia page. I accept that this person is more knowledgeable than me in the field of chemistry.

Just for fun, I'm going to show you how fast our database server can run an alter on a DB table that has 9 million rows in it.
The specs of the DB server are as follows:
CPU: 3.3Ghz e3-1230-V2 Ivy Bridge with HT
RAM: 8GB DDR3
HDD: 60GB Intel Solid State Drive 520 Series
OS: CentOS 6.5 x64

Code:

MariaDB [finalfan_forum]> SELECT COUNT(*) FROM dbtech_vbactivity_pointslog;
+----------+
| COUNT(*) |
+----------+
|  9051708 |
+----------+
1 row in set (0.00 sec)

As you can see, it has 9 million, 51 thousand, 7 hundred and 8 rows. This is approximately 6 times as many rows as you have in your "user" table.

A clean install of Advanced User Tagging (latest version at the time of writing) is going to run 9 alters in total against the "user" table (spread across 3 different installation steps). This modification does not alter the "post" table in any way, shape or form.

This is the result:
Code:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog ADD testcolumn INT(10) UNSIGNED NOT NULL DEFAULT '0';
Query OK, 9051708 rows affected (38.38 sec)           
Records: 9051708  Duplicates: 0  Warnings: 0

In other words, 1 out of 9 alters takes 38.38 seconds on a machine that is empirically slower than yours.

Extrapolating this further, 9 out of 9 alters would take approximately 345.42 seconds, or 5.76 minutes.

What about uninstallation, you ask?
Code:

MariaDB [finalfan_forum]> ALTER TABLE dbtech_vbactivity_pointslog DROP testcolumn;                                   
Query OK, 9051708 rows affected (35.60 sec)           
Records: 9051708  Duplicates: 0  Warnings: 0

1 out of 9 uninstallation steps takes 35.60 seconds.

Extrapolating this further, 9 out of 9 uninstallation steps would take 320.4 seconds or 5.34 minutes.

Even if we double, triple, quadruple, [...] the query time to account for the delay suffered when running this query via PHP as opposed to the command line, this does not come anywhere NEAR the 6+ hour time your server is experiencing.

The forum in question was http://www.finalfantasyforums.net/ which has over 1 million posts at the time of writing yet did not experience any issues when installing any of our modifications that make numerous alters to the "post" table.
(We host this forum, and the database server the forum runs on is the machine whose specs I listed above.)

I'm very much going to enjoy hearing your next round of excuses :)

Fillip

Who said excuses. I know what i encountered. You want to tell me that only your plugins are causing issues on my forum when install or uninstall and all the other plugins by other members doesn't have the same affect ? Because that is what i noticed and saw (only yours), that is why i said i never try to install any because of this issue, it is kinda scary actually not knowing when the task will be finished and to wait that long.

My server admin has access to this topic and there is a pending ticket, i am sure if he noticed something wrong, he will let me know.

Quote:

Originally Posted by Tigga (Post 2498970)
I doubt many others make as many table alterations as his, simply because they're not necessary for that modification or because the author may not realize that altering a vB table would be better than trying to keep up with separate tables. I fully agree that it's best to avoid altering vB tables when you can, but it's often not the best practice if you want an add-on to run smoothly and without taking up any extra server resources. I'd much rather have it shut down my forum for 10 minutes during the install than to have it running extra queries during every page load after that. A 6 hour install time is obviously different, but apparently you're the only one that's experiencing times that are anywhere near that extreme, so I'd say it sounds more like DB has things balanced correctly and it's your server configuration that is suspect.

I always have my forum turned off when installing any plugin.

final kaoss 05-22-2014 05:06 PM

Send him over here and get him posting... it's probably about time he voiced in his opinion on the matter.

katie hunter 05-22-2014 05:09 PM

Quote:

Originally Posted by final kaoss (Post 2498988)
Send him over here and get him posting... it's probably about time he voiced in his opinion on the matter.

No way, VB community isn't like Webhostingtalk. Argue, argue and fights is what i usually see on VB when it comes to proving a point and it never stops.

If you'd like to discuss about servers, the right location is here http://www.webhostingtalk.com

Necrovaris 05-22-2014 05:17 PM

Quote:

Originally Posted by katie hunter (Post 2498989)
No way, VB community isn't like Webhostingtalk. Argue, argue and fights is what i usually see on VB when it comes to proving a point and it never stops.

If you'd like to discuss about servers, the right location is here http://www.webhostingtalk.com

All the relevant information to the discussion has already been posted here, why duplicate it elsewhere.

The discussion afterall is about vBulletin addon installs.

Lets see what your guy has to say.

By the way, I see you skipped over my point of offering you the opportunity to test this on a properly configured server, using your own data as the test medium, any reason for that?

Zachery 05-22-2014 05:50 PM

Quote:

Originally Posted by katie hunter (Post 2498989)
No way, VB community isn't like Webhostingtalk. Argue, argue and fights is what i usually see on VB when it comes to proving a point and it never stops.

If you'd like to discuss about servers, the right location is here http://www.webhostingtalk.com

I'd be more than willing to test on your database as well for this specific case. If you'd prefer me, over another random person.

We're not arguing, or fighting. We're showing you cold hard evidence that these addons, applied to our systems, are not taking anywhere near as long, with significantly less optimal database hardware, and environments.

DragonByte Tech 05-22-2014 05:58 PM

Quote:

Originally Posted by katie hunter (Post 2498984)
Who said excuses.

You did. Up until this post, you were constantly making excuses as to why all the hard evidence against your claims were false.

Quote:

Originally Posted by katie hunter (Post 2498984)
I know what i encountered.

Nobody disputes the fact that you encountered what you encountered. Everybody disputes the fact that you believe that your results are the fault of our modifications, as opposed to your server configuration.

Quote:

Originally Posted by katie hunter (Post 2498984)
You want to tell me that only your plugins are causing issues on my forum when install or uninstall and all the other plugins by other members doesn't have the same affect ?

I want to tell you that you need to stop having blind faith in one person when you are faced with overwhelming evidence that irrefutably proves that there is something wrong with your server configuration.

If you were to install another product by another coder that also alters the user or post table, you would face the exact same issues. You have not installed any such modifications, and you seem to believe that this still means your sample is evidence that our products are somehow magically causing your server to behave oddly.

Quote:

Originally Posted by katie hunter (Post 2498984)
My server admin has access to this topic and there is a pending ticket, i am sure if he noticed something wrong, he will let me know.

I certainly hope so, because if he claims that there is nothing wrong, then he does not know his job.


Fillip

cellarius 05-22-2014 06:55 PM

Quote:

Originally Posted by katie hunter (Post 2498989)
No way, VB community isn't like Webhostingtalk. Argue, argue and fights is what i usually see on VB when it comes to proving a point and it never stops.

Yes, threads you post in seem to have that tendency. :p

Anyway, I have followed this thread with a large bin of popcorn. :D

OldSchoolDSL 05-23-2014 12:05 AM

Quote:

Originally Posted by katie hunter (Post 2498580)

:p:rolleyes:
http://youtu.be/r0yXqU-w9U0

Paul M 05-23-2014 11:44 AM

Quote:

Originally Posted by katie hunter (Post 2498989)
No way, VB community isn't like Webhostingtalk. Argue, argue and fights is what i usually see on VB when it comes to proving a point and it never stops.[/url]

Probably because you keep trying to argue a point when you are wrong.
Everyone has told you that your server is the issue, several have even proved it for you.

We still await your apology .... :)

final kaoss 05-23-2014 12:06 PM

Anyways, I'll be watching vbseo since I have a license to see what happens. Them earning back my trust probably isn't very likely though.

Here's something to help lighten up the arguing going on here with Katie however.

https://vborg.vbsupport.ru/external/2014/05/15.jpg

katie hunter 05-23-2014 03:58 PM

You guys haven't proven anything, stop dreaming about it. Especially Paul.

This is all "he say, she say" type of conversation. And of course this won't stop, the back and forth and everyone trying to prove something :0) lets go back to the main topic, Vbseo! If i ever use any of Fillip's plugin, it would be on a new project/site but not with a popular community.

I am also not a fan of plugins which alter vb tables heavily but that is just me, especially when upgrading VB to a new version, you wouldn't want to mess with how the original tables should be, it saves future problems.

Zachery 05-23-2014 04:39 PM

Wait, you mean we run the same code you do, and it executes in a fraction of the time its taking you, that isn't proof?


There are no issues adding new tables, or new columns into tables, if you take the time to prefix your work. Otherwise any addon ever could run into the same problem.

Paul M 05-23-2014 10:15 PM

Quote:

Originally Posted by katie hunter (Post 2499132)
You guys haven't proven anything, stop dreaming about it. Especially Paul.

Clearly you are as daft as you are stubbon.
If you cannot accept what everyone is telling you then there is no point in arguing about it further. Closed.


All times are GMT. The time now is 06:11 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01369 seconds
  • Memory Usage 1,846KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (6)bbcode_code_printable
  • (20)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (1)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (21)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete