vb.org Archive

vb.org Archive (https://vborg.vbsupport.ru/index.php)
-   Big Board Discussions (https://vborg.vbsupport.ru/forumdisplay.php?f=172)
-   -   Big Boarders & Backups.. (https://vborg.vbsupport.ru/showthread.php?t=163939)

Jafo232 12-19-2007 05:11 AM

Quote:

Originally Posted by amcd (Post 1404241)
this thread is in the big boards forum.

And??

TECK 12-19-2007 05:47 PM

Quote:

Originally Posted by Jafo232 (Post 1403652)
By using incremental backups with hard linking, you can keep snapshots on the backup server to allow for rollbacks to certain times (hourly, daily, weekly, monthly)..

You can keep snapshots with rcync, there is no need to complicate your life with incremental backups.
Only a few resources (out of many available):
Mike Rubel's rsync snapshots - the original rsync script
rsnapshot - based off Mike Rubel's article, my preferate
Dirvish - the most feature-filled of these programs

Output on rsnapshot:
Code:

[root@localhost /]# rsnapshot -v daily
echo 1842 > /var/run/rsnapshot.pid
/bin/rm -rf /.snapshots/daily.6/
mv /.snapshots/daily.5/ /.snapshots/daily.6/
mv /.snapshots/daily.4/ /.snapshots/daily.5/
mv /.snapshots/daily.3/ /.snapshots/daily.4/
mv /.snapshots/daily.2/ /.snapshots/daily.3/
mv /.snapshots/daily.1/ /.snapshots/daily.2/
mv /.snapshots/daily.0/ /.snapshots/daily.1/
mv /.snapshots/hourly.5/ /.snapshots/daily.0/
rm -f /var/run/rsnapshot.pid
[root@localhost /]#

Disk usage report on a subdirectory over time:
Code:

[root@localhost /]# rsnapshot du example.com/home/
5.2G    /.snapshots/hourly.0/example.com/home/
5.4M    /.snapshots/hourly.1/example.com/home/
12M    /.snapshots/hourly.2/example.com/home/
5.3M    /.snapshots/hourly.3/example.com/home/
5.4M    /.snapshots/hourly.4/example.com/home/
4.9M    /.snapshots/hourly.5/example.com/home/
5.4M    /.snapshots/daily.0/example.com/home/
728M    /.snapshots/daily.1/example.com/home/
4.8M    /.snapshots/daily.2/example.com/home/
4.8M    /.snapshots/daily.3/example.com/home/
6.2M    /.snapshots/daily.4/example.com/home/
4.8M    /.snapshots/daily.5/example.com/home/
4.8M    /.snapshots/daily.6/example.com/home/
6.0G    total

You see? It is possible. ;)

Have your pick, or if you are not happy with this solution, simply use rdiff-backup. It is based on rsync and stores incremental rdiff deltas with the backup, with which it is possible to recreate any backup point. You problem is solved in 2 seconds. :)
Compared to rdiff-backup, rsync is faster, so it is often the better choice when pure mirroring is required. Also, rdiff-backup does not have a separate server like rsyncd (instead it relies on ssh-based networking and authentication). However, rdiff-backup uses much less memory than rsync, on large directories.

Quote:

Originally Posted by Jafo232 (Post 1404244)
And??

What amcd meant is: if you are a big board owner, you either know your terminal really well or... you have money to hire an admin as company employee. He will do the job for you. Either ways, the person will be very capable to complete the rsync job himself.

Jafo232 12-19-2007 05:52 PM

Actually, I have done custom work for quite a few big boarders who barely had knowledge of FTP, much less the terminal, negating both points I think.

TECK 12-19-2007 06:06 PM

That corresponds with my above statement: "you have money to hire an admin..."
In other words, you were hired to do a backup by the big board owner. If I have money, I would never bother to learn all those "rsync thingies", I will hire you to do it for me. I will spend my time to get more clients who will advertise on my board, because I'm a business guy, not a Linux lover. :)

EricGT 12-25-2007 02:03 AM

I wrote a script that shuts down Apache and MySQL each night, does an rsync of the DB directory to a backup directory on the server, restarts Apache & MySQL and then rsync's the backup directory to dedicated backup server. I maintain an encrypted tunnel between a server at home and the firewall of my remote network and rsync the backup directory of the backup server to a system at my home nightly. I also run a mysqldump of the DB once a week and rsync it to the backup server and home. There is no site without the data and I've been doing this long enough to fear and respect Murphy's Law. Eric

TECK 12-27-2007 04:17 AM

There is not need to shut down your server. You are basically deny access to users during that backup time. :)
Use rsnapshot, it is transparent... and it does incremental backups hourly.

Jafo232 12-27-2007 06:33 AM

I can understand shutting down httpd/mysqld I guess, when you are backing up the database binaries, myself though, I just do an automated mysql dump and let rsync back up the dump file.

EricGT 12-27-2007 05:38 PM

Quote:

Originally Posted by Jafo232 (Post 1409955)
I can understand shutting down httpd/mysqld I guess, when you are backing up the database binaries, myself though, I just do an automated mysql dump and let rsync back up the dump file.

I can back up and restore the binaries in a fraction of the time it takes to do a dump or restore it. I shut the MySQL server down so I know I get a clean copy. I also do a weekly mysqldump, to backstop the binary rsync.

TecK, I haven't heard of rsnapshot. I'll give a look. Thanks for the tip. Eric

TECK 12-27-2007 06:51 PM

My pleasure, Eric.

link: http://www.rsnapshot.org/
screenshots: http://www.rsnapshot.org/screenshots.html


All times are GMT. The time now is 11:29 AM.

Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.

X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.01148 seconds
  • Memory Usage 1,740KB
  • Queries Executed 10 (?)
More Information
Template Usage:
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (2)bbcode_code_printable
  • (4)bbcode_quote_printable
  • (1)footer
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (6)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (1)post_thanks_navbar_search
  • (1)printthread
  • (9)printthreadbit
  • (1)spacer_close
  • (1)spacer_open 

Phrase Groups Available:
  • global
  • postbit
  • showthread
Included Files:
  • ./printthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/class_bbcode_alt.php
  • ./includes/class_bbcode.php
  • ./includes/functions_bigthree.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • printthread_start
  • pagenav_page
  • pagenav_complete
  • bbcode_fetch_tags
  • bbcode_create
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • printthread_post
  • printthread_complete