Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > General > Big Board Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
how much queries do you have running whan a... Details »»
how much queries do you have running whan a...
Version: , by Yellow Slider Yellow Slider is offline
Developer Last Online: Nov 2023 Show Printable Version Email this Page

Version: Unknown Rating:
Released: 06-13-2007 Last Update: Never Installs: 0
 
No support by the author.

Index page is loading? - 10 q'
forum page is loading? - 15 q'
thread page is loading?- 34-35 q' (something is wrong and it's killing the server..)

I have to find out why the hell i have 35 q' when a thread is loading, its killing my server, somthing like 400 users are entering a page in a sec, do the math :X

so i wanted to see what is the situation on other boards ?

thanks lot for cooperating :]

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #22  
Old 07-25-2007, 08:04 AM
TECK's Avatar
TECK TECK is offline
 
Join Date: Nov 2001
Location: Canada
Posts: 4,182
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

DEBUG mode enabled, logged as Guest:
Index
* Page Generation 0.01844 seconds
* Memory Usage 553KB
* Queries Executed 4

Forumdisplay
* Page Generation 0.03062 seconds
* Memory Usage 635KB
* Queries Executed 9

Showthread
* Page Generation 0.03081 seconds
* Memory Usage 778KB
* Queries Executed 6

DEBUG mode enabled, logged as Admin:
Index
* Page Generation 0.02090 seconds
* Memory Usage 602KB
* Queries Executed 5

Forumdisplay
* Page Generation 0.03693 seconds
* Memory Usage 714KB
* Queries Executed 10

Showthread
* Page Generation 0.05298 seconds
* Memory Usage 921KB
* Queries Executed 7

I might work on the forumdisplay to lower it even more... but I really don't like to edit the vBulletin code. The above results were obtained while inserting code into hooks.
I think the best part is the memory usage. I lowered it's value from 3500KB to 600-900KB.

I use lighttpd as server software. All applications are set on bleeding edge.
Yes, I hate Apache... it eats memory like an elephant.

EDIT: I use both XCache and memcached, on my server.
Since we are here, I wonder if it's better to simply remove the queries or cache them with memcached. Somehow, I think 4 queries on the frontpage is better then 9, even with mighty memcached. Another issue is how to check if memcached is actually caching the queries. If I use -vv, it will give me all kind of huge numbers into the log files. However, memcached lacks on documentation so it's actually hard to know how and when the queries are processed/cached.

Let me know what you think about this matter. Thanks for your advice.

Quote:
Originally Posted by mute View Post
There are queries, but they hit memcache, and don't count.
Actually, they count very much. Even if memcached caches your datastore, it will still use bandwidth. Yes you save the processor, but your month bandwidth will increase. On the other hand, if you use XCache... it will chew the disk I/O. The real question is: What is more beneficial, performance wise?

Thanks for the input.
Reply With Quote
  #23  
Old 07-27-2007, 09:54 AM
BamaStangGuy's Avatar
BamaStangGuy BamaStangGuy is offline
 
Join Date: Mar 2004
Location: Alabama
Posts: 521
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

That is very impressive TECK
Reply With Quote
  #24  
Old 07-27-2007, 01:57 PM
mute mute is offline
 
Join Date: Dec 2002
Location: Phoenixville, PA
Posts: 152
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by TECK View Post
Actually, they count very much. Even if memcached caches your datastore, it will still use bandwidth. Yes you save the processor, but your month bandwidth will increase. On the other hand, if you use XCache... it will chew the disk I/O. The real question is: What is more beneficial, performance wise?

Thanks for the input.
In my opinion, bandwidth will always be cheaper than CPU time or disk. I don't see how moving a query from hitting a MySQL database to memcache increases my bandwidth any, unless you're referring to the traffic between the memcache or database server and your webservers, but I'd hope that any site that is doing enough traffic to justify a memcache setup would most likely have an unmetered private network between their servers.
Reply With Quote
  #25  
Old 07-27-2007, 11:52 PM
TECK's Avatar
TECK TECK is offline
 
Join Date: Nov 2001
Location: Canada
Posts: 4,182
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

In my opinion, bandwidth will always be cheaper than CPU time or disk.
Very good point, mute.

I'd hope that any site that is doing enough traffic to justify a memcache setup would most likely have an unmetered private network between their servers.
Another excellent reflection.

So what do we do. Do we put emphasis on the memcached or XCache? In other words, more queries and less PHP files to be cached?
Personally, I never liked executing queries. Instead, I cache the query data with XCache... avoiding possible table locks. I have this theory: the less queries you run the easier it is for the MySQL server.

Recently, I had an interesting talk with one of the vBulletin developers and he told me that they are not 100% sure what is the best solution: cache more queries or files.
For example, in vBulletin 4, you will be able to cache the templates as files, on the vBulletin datastore, or directly with memcached.
That is quite ingenious, since you have the liberty to use whatever method suits best your forum.

Please guys, comment more on this issue. Your opinion is important to me.

Floren
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 08:51 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04012 seconds
  • Memory Usage 2,250KB
  • Queries Executed 21 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (2)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (5)post_thanks_box
  • (5)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (5)post_thanks_postbit_info
  • (4)postbit
  • (5)postbit_onlinestatus
  • (5)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete