vb.org Archive - Backing up large databases

Page 3 of 4

Show 40 post(s) from this thread on one page

vb.org Archive (https://vborg.vbsupport.ru/index.php)

- General Hosting/Server Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=197)

- - Backing up large databases (https://vborg.vbsupport.ru/showthread.php?t=112659)

Erwin

04-28-2006 12:39 AM

Quote:

Originally Posted by The Prohacker

http://dev.mysql.com/books/hpmysql-excerpts/ch07.html

We have several database servers for our sites, so we have a single slave server called dbbackup. It runs multiple instances of Mysql all running as slaves replicating data from their respective master. From there we have a perl/shell script locks all tables on the slave process and copies all binary files and then unlocks all tables when done.

We actually have 6 master DB servers, so its rater interesting to get everything to replicate to a single server from which you can create backups.

This eliminates the table locking issue on the master server and possibly taking your sites offline for backups.

I highly recommend getting the book High Performance MySQL which the above chapter is from..

-Mat

All I can say is wow. That's a lot of master DB servers.

The Prohacker

04-28-2006 05:14 PM

Quote:

Originally Posted by Erwin

All I can say is wow. That's a lot of master DB servers.

None of them are linked with each other :) WHT, dBforums, HotScripts, DeletedDomains, and our ad server have their own servers with the smaller sites scattered across them to fill in the gaps. We are at capacity at this point. I would love to move to a mCluster type system, but I am skeptical. It's a job keeping replication going at times. I don't envy having to host a single site the size of yours Erwin. My biggest problem with replication is DeletedDomains database which has 2500 tables and is 150Gb.

-Mat

Erwin

04-29-2006 06:14 AM

Holy moly, you own WHT and Hostscripts? :) Yes, mine is a single db which has its own issues.

DevilYellow

05-06-2006 02:10 AM

at what point does it really matter?

is mysqldump still ok for DB's in the range of a few GB's?

currently I just hit 1GB and plan on splitting to two new servers in about 12 months. I am still on mysql3.

Xorlev

05-07-2006 05:35 PM

Oh boy...I recommend you get up to MySQL 4.1 at least. And mysqldump should still work, but I'm not too sure about that as my database is currently only a few hundred megabytes and not twenty gigabytes.

DevilYellow

05-07-2006 10:34 PM

I am going to to build a new DB server and run Mysql 5... then somehow re-do the current server with a new OS, new php, and maybe litespeed httpd.

I do not know how I am going to do that tho.

Erwin

05-07-2006 11:29 PM

I just did the same and run MySQL 5.1 with new OS and using lighttpd.

kmike

05-08-2006 06:17 PM

Here's an interesting backup technique: using LVM to take live snapshots of the database, (almost) without any downtime:
http://pointyhair.com/tiki-view_blog...gId=1&postId=5
http://mike.kruckenberg.com/archives...backups_u.html

jcerious

06-10-2006 07:43 PM

Quote:

Originally Posted by Krofh

Thanks for the recommendations everyone... We're moving to our new server tomorrow. It's only a 300 MB database, so hopefully it shouldn't be too hard.

Only 300 Mbs - mine's only 11! I feel like a bug in your ocean!

Wynand

06-19-2006 05:55 PM

i'm letting my database back-up automatic. CRONTAB in SSH makes it automatic and removes the old ones. Every hour a backup (when forum get's bigger, possibly every minute..) and a delete of the backup of 2 days ago :)

Just a littel linux knowlegde :cool: :banana:

All times are GMT. The time now is 07:07 PM.

Page 3 of 4

Show 40 post(s) from this thread on one page

X vBulletin 3.8.12 by vBS Debug Information
Page Generation 0.01310 seconds Memory Usage 1,739KB Queries Executed 10 (?)
More Information
Template Usage: (1)ad_footer_end (1)ad_footer_start (1)ad_header_end (1)ad_header_logo (1)ad_navbar_below (3)bbcode_quote_printable (1)footer (1)gobutton (1)header (1)headinclude (6)option (1)pagenav (1)pagenav_curpage (3)pagenav_pagelink (1)post_thanks_navbar_search (1)printthread (10)printthreadbit (1)spacer_close (1)spacer_open Phrase Groups Available: global postbit showthread	Included Files: ./printthread.php ./global.php ./includes/init.php ./includes/class_core.php ./includes/config.php ./includes/functions.php ./includes/class_hook.php ./includes/modsystem_functions.php ./includes/class_bbcode_alt.php ./includes/class_bbcode.php ./includes/functions_bigthree.php Hooks Called: init_startup init_startup_session_setup_start init_startup_session_setup_complete cache_permissions fetch_threadinfo_query fetch_threadinfo fetch_foruminfo style_fetch cache_templates global_start parse_templates global_setup_complete printthread_start pagenav_page pagenav_complete bbcode_fetch_tags bbcode_create bbcode_parse_start bbcode_parse_complete_precache bbcode_parse_complete printthread_post printthread_complete
Messages: