Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > General > Big Board Discussions
Cloning big databases - streamlining the process? Details »»
Cloning big databases - streamlining the process?
Version: , by Guest210212002 (Guest)
Developer Last Online: Jan 1970 Show Printable Version Email this Page

Version: Unknown Rating:
Released: 02-11-2008 Last Update: Never Installs: 0
 
No support by the author.

I'm copying the latest incarnation of my database onto my test platform so that I can run a test upgrade to the newest vB. The mysql import of the data has been running for almost 2 hours and it's still working on the post table. (ugh!)

Is there a better/easier way to go about this? I'd LOVE to just drop all the posts and copy everything else over, since I really don't need a copy of 1 million posts on my test platform. And if I hose this DB (which I very well might, since I'll be fiddling around) doing it all over again would really not make my day.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #2  
Old 02-12-2008, 12:35 AM
EricGT EricGT is offline
 
Join Date: Jan 2004
Posts: 56
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

For something like that, I'll usually turn off the primary database long enough to rsync the database binaries to the new location. It is much faster. Once a copy of the binaries have been made, you can overwrite the test DB over and over, as needed, and do so very quickly. If you are doing a DB dump, don't include the searchindex/postindex table and the attachments table, if you are storing attachments in the database. You probably won't need this info for an upgrade attempt. When I was still storing attachments in the DB, these two tables alone accounted for about 61% of my total DB size. Eric
Reply With Quote
  #3  
Old 02-12-2008, 02:26 AM
Guest210212002
Guest
 
Posts: n/a
Default

I do everything from command line, so when I dump my DB it's something like mysqldump (mydb) > dump.sql. Is there a way to skip the postindex/searchindex tables via command line? Or are you doing it with phpMyAdmin?

[high]* Guest210212002 is intrigued
[/high]

I'm not moving servers, just making a clone of my current site on the same box under a private subdomain so that I can run the 3.7 installer on it and see what breaks.
Reply With Quote
  #4  
Old 02-12-2008, 03:05 PM
EricGT EricGT is offline
 
Join Date: Jan 2004
Posts: 56
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by Chris-777 View Post
I do everything from command line, so when I dump my DB it's something like mysqldump (mydb) > dump.sql. Is there a way to skip the postindex/searchindex tables via command line? Or are you doing it with phpMyAdmin?

[high]* Chris-777 is intrigued
[/high]

I'm not moving servers, just making a clone of my current site on the same box under a private subdomain so that I can run the 3.7 installer on it and see what breaks.
Hello. You can use: '--ignore-table=name' to ignore a table in a DB dump. If you want to ignore multiple tables, you would use the directive multiple times. Run 'man mysqldump' or 'mysqldump --help' for more information. Eric
Reply With Quote
  #5  
Old 02-14-2008, 02:34 AM
EricGT EricGT is offline
 
Join Date: Jan 2004
Posts: 56
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by EricGT View Post
Hello. You can use: '--ignore-table=name' to ignore a table in a DB dump. If you want to ignore multiple tables, you would use the directive multiple times. Run 'man mysqldump' or 'mysqldump --help' for more information. Eric
Sorry, the syntax is actually: ' --ignore-table=database.name '. I forgot to put the DB name in there. I was just backing up my database and realized I had forgotten that. Eric
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 07:24 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2024, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.08280 seconds
  • Memory Usage 2,227KB
  • Queries Executed 18 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (2)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (5)post_thanks_box
  • (5)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (5)post_thanks_postbit_info
  • (4)postbit
  • (3)postbit_onlinestatus
  • (5)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • postbit_imicons
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete