Go Back   vb.org Archive > Community Discussions > Forum and Server Management
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools Display Modes
  #1  
Old 06-07-2009, 09:57 PM
t3nt3tion's Avatar
t3nt3tion t3nt3tion is offline
 
Join Date: Aug 2005
Location: 3rd Planet from the Sun
Posts: 70
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default Huge database, agonizing speed

I have a huge database, over 10 GB, and when I try to delete threads, it takes about 20 hours to delete 70 threads ... I`m doing some cleanup due to adsense being nasty about no-porn-on-threads rule, and I`m doing some mass deletions.
I was thinking of converting the post and postindex tables to innodb, to benefit on the row level locking feature ... still I`d like to know if anyone has had these issues and what solutions you used.
Reply With Quote
  #2  
Old 06-07-2009, 10:11 PM
snakes1100 snakes1100 is offline
 
Join Date: Dec 2001
Location: Michigan
Posts: 3,733
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I wouldn't use InnoDB on the post tables.

If its taking you 20 hrs to delete 70 threads, i think you have other issues, lack of hardware to support your DB correctly or issues in the DB itself (bad indexes etc)

Im assuming the link in your sig is actually your site, couldnt tell what your exact stats were.
Reply With Quote
  #3  
Old 06-07-2009, 10:15 PM
Paul M's Avatar
Paul M Paul M is offline
 
Join Date: Sep 2004
Location: Nottingham, UK
Posts: 23,748
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

We dont use the postindex table, we switched to mysql search.
Reply With Quote
  #4  
Old 06-07-2009, 10:22 PM
t3nt3tion's Avatar
t3nt3tion t3nt3tion is offline
 
Join Date: Aug 2005
Location: 3rd Planet from the Sun
Posts: 70
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Yes, the site is from my signature. I`m still on 3.7.4 since I have a custom mod which I don`t have time to port to 3.8.2.
@snakes1100 : I doubt it`s hardware, as I have 0 usage when the site works normally, and when I do a thread delete, loads jump to 7-10.
I did alot of mysql optimizations and tweaking to match my server configuration, and get the most out of it.

Stats :
Threads: 1,033,025, Posts: 6,438,233
Reply With Quote
  #5  
Old 06-07-2009, 11:01 PM
Seven Skins's Avatar
Seven Skins Seven Skins is offline
 
Join Date: Sep 2008
Location: London, UK
Posts: 1,481
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Some of your posts have dates in future: 02-09-2015
e.g. http://www.varioustopics.com/uk/1035...real-deal.html

.
Reply With Quote
  #6  
Old 06-08-2009, 11:49 AM
t3nt3tion's Avatar
t3nt3tion t3nt3tion is offline
 
Join Date: Aug 2005
Location: 3rd Planet from the Sun
Posts: 70
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I know, something with the importer. That`s not my pressing issue at the moment
Reply With Quote
  #7  
Old 06-10-2009, 03:48 PM
t3nt3tion's Avatar
t3nt3tion t3nt3tion is offline
 
Join Date: Aug 2005
Location: 3rd Planet from the Sun
Posts: 70
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Well, I converted my post, thread and word tables to inno, but found out I have to create new tables, set it to inno, copy the data over, and only then switch to those tables, else it won`t take inno right.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 09:17 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04218 seconds
  • Memory Usage 2,214KB
  • Queries Executed 11 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)ad_showthread_firstpost
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)navbar
  • (3)navbar_link
  • (120)option
  • (7)post_thanks_box
  • (7)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (7)post_thanks_postbit_info
  • (7)postbit
  • (7)postbit_onlinestatus
  • (7)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete