Go Back   vb.org Archive > vBulletin Modifications > Archive > vB.org Archives > General > Big Board Discussions

Reply
 
Thread Tools
Big Boarders & Backups.. Details »»
Big Boarders & Backups..
Version: , by Jafo232 Jafo232 is offline
Developer Last Online: Oct 2022 Show Printable Version Email this Page

Version: Unknown Rating:
Released: 11-30-2007 Last Update: Never Installs: 0
 
No support by the author.

My last few projects have been with boards that fit the big board description. Hundreds of thousands of members, millions of posts, and tons of activity.

Usually I am hired on to help with fixing issues with plugins, writing custom plugins, optimizing, etc.. My last three clients, in addition to other things, all wanted consultation on backing up data. For the most part, they all had in common one feeling and that was that they had little to no faith in their dedicated hosting provider when it came to the backups. Either they did not understand it, or were somehow discouraged when they tried to use it last.

My last/current client actually bought me a drive and begged me to backup his data for him (for a fee of course).. Well, I have always had my own system for backing up my servers which allows me to have incremental backups so you could have hourly/weekly/monthly/yearly backups. Using rsync and hard links, I have multiple backups without using a ton of storage. Basically if something happened to my data, I could get back the last hours version of it. So I set him up with the same thing and he was ecstatic.. Gave him FTP access to the server where I stored his backups (using the drive he bought ) and he could see, and download all of his files at any interval..

Got me thinking about the demand for such a thing. Is this common with big boarders here? What would happen to you tomorrow if your servers hard drive(s) suffered some ill fate (power surge, water damage, dead drive, etc..)? Are you confident in your backup strategy?

The reason why I ask is, if there is a demand out there for it, I might consider running a small service to do it, but before I even bother, I thought of asking here first..

Show Your Support

  • This modification may not be copied, reproduced or published elsewhere without author's permission.

Comments
  #2  
Old 11-30-2007, 12:46 PM
Hornstar Hornstar is offline
 
Join Date: Jun 2005
Location: Australia
Posts: 2,469
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I'd be interested in such a service, but depending on how much it would cost would be a factor, because my dedicated server is costing me enough already.
Reply With Quote
  #3  
Old 11-30-2007, 12:51 PM
Marco van Herwaarden Marco van Herwaarden is offline
 
Join Date: Jul 2004
Posts: 25,415
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I doubt many want a backup service that is not located at the same physical place or at least have a direct highspeed network connection to such a location.

I would not have to push my backups over the regular internet conneections.
Reply With Quote
  #4  
Old 11-30-2007, 03:35 PM
Jafo232 Jafo232 is offline
 
Join Date: May 2004
Posts: 1,122
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Funny, I always thought the idea of having a remote backup a selling point. If say that same physical place caught on fire and burned down what good would having a backup system be there?

My backups transmit over the regular Internet yes, via SSH..

I haven't even considered a price..
Reply With Quote
  #5  
Old 12-01-2007, 02:04 AM
weeno weeno is offline
 
Join Date: Jan 2002
Posts: 61
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Obviously, the big issue with big-boards is regular backups to the mysql db. For me, mysqlhotcopy took too long to use frequently. I ended up having to go with binary logs and weekly mysqlhotcopies.

arn
Reply With Quote
  #6  
Old 12-01-2007, 06:18 AM
Marco van Herwaarden Marco van Herwaarden is offline
 
Join Date: Jul 2004
Posts: 25,415
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

A physical remote location is good in case of fire etc., but you should ensure that there is a fast direct connection between the 2 locations.
Reply With Quote
  #7  
Old 12-04-2007, 03:19 AM
ssslippy ssslippy is offline
 
Join Date: Jan 2006
Posts: 877
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Ive noticed its become common for a hosting company to have a backup on remote these days.
Reply With Quote
  #8  
Old 12-04-2007, 04:52 AM
Ted S Ted S is offline
 
Join Date: Dec 2003
Location: SoCal
Posts: 3,954
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

Quote:
Originally Posted by ssslippy View Post
Ive noticed its become common for a hosting company to have a backup on remote these days.
Exactly. Virtually every hosting company now offers off-site backup solutions for those who want them. At the very least, a host will provide an off-machine backup or NAS access to do a more secure and cluster/machine independent backup. There are however companies that offer these services and do well at it... but to enter the marketplace, you'd be competing against established players and need to do a lot to insure your system's reliability and security. The last thing a site needs is to be outsourcing their backup solution to someone running a "small service" that ends up crashing.
Reply With Quote
  #9  
Old 12-04-2007, 05:03 AM
Jafo232 Jafo232 is offline
 
Join Date: May 2004
Posts: 1,122
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I can understand that.. Many of the dedicated solutions I have seen include some sort of backup service.. Mine would be compliment that backup and offer some level of redundancy..

Thinking of prices, I was contemplating about $100/mo to backup 25gb of data... Opinions?
Reply With Quote
  #10  
Old 12-04-2007, 02:38 PM
amcd amcd is offline
 
Join Date: Oct 2004
Posts: 218
Благодарил(а): 0 раз(а)
Поблагодарили: 0 раз(а) в 0 сообщениях
Default

I do a full mysqldump of the db once a day at the least busy hour and the .tgz is rsynced to another server 3000 kilometers away.
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 05:26 PM.


Powered by vBulletin® Version 3.8.12 by vBS
Copyright ©2000 - 2025, vBulletin Solutions Inc.
X vBulletin 3.8.12 by vBS Debug Information
  • Page Generation 0.04532 seconds
  • Memory Usage 2,283KB
  • Queries Executed 23 (?)
More Information
Template Usage:
  • (1)SHOWTHREAD
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_header_end
  • (1)ad_header_logo
  • (1)ad_navbar_below
  • (1)ad_showthread_beforeqr
  • (1)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)modsystem_post
  • (1)navbar
  • (6)navbar_link
  • (120)option
  • (1)pagenav
  • (1)pagenav_curpage
  • (2)pagenav_pagelink
  • (10)post_thanks_box
  • (10)post_thanks_button
  • (1)post_thanks_javascript
  • (1)post_thanks_navbar_search
  • (10)post_thanks_postbit_info
  • (9)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available:
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files:
  • ./showthread.php
  • ./global.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/class_hook.php
  • ./includes/modsystem_functions.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_post_thanks.php 

Hooks Called:
  • init_startup
  • init_startup_session_setup_start
  • init_startup_session_setup_complete
  • cache_permissions
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • style_fetch
  • cache_templates
  • global_start
  • parse_templates
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • forumjump
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • post_thanks_function_post_thanks_off_start
  • post_thanks_function_post_thanks_off_end
  • post_thanks_function_fetch_thanks_start
  • post_thanks_function_fetch_thanks_end
  • post_thanks_function_thanked_already_start
  • post_thanks_function_thanked_already_end
  • fetch_musername
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • post_thanks_function_can_thank_this_post_start
  • pagenav_page
  • pagenav_complete
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • showthread_complete