Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > General > Big Board Discussions
FAQ Community Calendar Today's Posts Search

Reply
 
Thread Tools
Backing up Attachments Details »»
Backing up Attachments
Version: , by Lynne Lynne is offline
Developer Last Online: Oct 2022 Show Printable Version Email this Page

Version: Unknown Rating:
Released: 06-21-2007 Last Update: Never Installs: 0
 
No support by the author.

I'm interested to hear other admins methods of backing up their attachments folder.

My site runs on two servers - one is the webserver, the other is for mysql. My attachments are stored in the file system on the main webserver. Currently, we have a bit over 4.2 GB in attachments. My method of backing them up is to do a backup of that folder once a week in the middle of the night (that is the lowest activity for us) using a cron job I wrote. All it does is tar the attachment folder and then put that backup in the backup folder on that server. Then, I manually go and scp a copy over to the mysql server every week. So, we end up with two copies of the backup - one on each server.

I just know there must be a better way to do this. It seems kinda stupid to make a whole tar of the folder every week when most of those attachments stay the same. Does anyone have a better script to use to do their backups? Or a better suggestion on how to handle their attachments?

Thanks for any input.

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #2  
Old 06-23-2007, 02:42 AM
Lynne's Avatar
Lynne Lynne is offline
 
Join Date: Sep 2004
Location: California/Idaho
Posts: 41,180
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

No one has any comments about this? I know other sites must backup their attachments using some method.
Reply With Quote
  #3  
Old 06-26-2007, 07:27 PM
COBRAws's Avatar
COBRAws COBRAws is offline
 
Join Date: Oct 2002
Location: Buenos Aires
Posts: 864
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I just FTP orSSH and download them to a backup server.
Reply With Quote
  #4  
Old 06-26-2007, 07:29 PM
da420 da420 is offline
 
Join Date: Nov 2005
Posts: 1,232
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I just gzip the folder via SSH, and download via FTP.
Reply With Quote
  #5  
Old 06-26-2007, 08:35 PM
Shazz's Avatar
Shazz Shazz is offline
 
Join Date: Jun 2006
Location: Utah
Posts: 4,758
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I moved all my attachments to file system and I backed them up using FTP
Reply With Quote
  #6  
Old 06-27-2007, 02:44 PM
Lynne's Avatar
Lynne Lynne is offline
 
Join Date: Sep 2004
Location: California/Idaho
Posts: 41,180
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I have them in the file system, but we are talking about over 4 GB worth of attachments (and getting bigger every day). I figured some of you guys with big boards would also have this same 'problem'.
Reply With Quote
  #7  
Old 06-27-2007, 02:47 PM
Shazz's Avatar
Shazz Shazz is offline
 
Join Date: Jun 2006
Location: Utah
Posts: 4,758
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

vB.org uses file system, I wonder how that works... :|
Reply With Quote
  #8  
Old 06-27-2007, 03:43 PM
Bigblah Bigblah is offline
 
Join Date: Mar 2006
Posts: 6
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I've done an update of a mirror of my attachments by accessing the backup server via SSH and running wget with the -N option (and -r and -l for recursive retrieval). wget can connect through FTP so you can point it to your attachment directory.

With that many attachments though, having wget retrieve every directory filelisting and check timestamps would certainly be a time consuming process.
Reply With Quote
  #9  
Old 07-08-2007, 12:30 AM
Angel-Pie Angel-Pie is offline
 
Join Date: Apr 2007
Posts: 67
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

i havent done any backing up yet, just getting the board together and then will back up the files but thanks for all the ideas!
Reply With Quote
  #10  
Old 07-08-2007, 09:47 AM
orban orban is offline
 
Join Date: Jan 2005
Posts: 445
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I rsync them to another server, smooth and painless. You can't possible gzip and download 5gb of attachments every couple days so we had to find another way.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 08:06 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04587 seconds
  • Memory Usage 2,279KB
  • Queries Executed 23 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (9)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete