farfromfearless

When backups fail

As a writer I think one of the last things on my mind are either version control and backups. I write and I'm done, I file it away somewhere I can recall quickly when inspiration strikes -- all well and good until my storage device decides to up and die on me. This happened recently and I am currently left with two choices: use an expensive data recovery service (with no guarantees), or walk away and chalk this up to a lesson learned.

In brief: my external storage device failed.

This is not a good thing considering I the external drive was both my external storage and "backup" device. I use the term "backup" loosely as I don’t actually have a consistent backup policy. You would think I would have a policy considering I’m quite diligent about backups and redundancy for my professional work. But I don’t.

So now I am left with the dilemma of choosing between a very expensive data recovery service of which there is only a marginal chance of retrieving any of my data intact, or walking away from this small catastrophe and chalking it all up to a lesson learned. This is not enjoyable at all.

While I have yet to come to a resolution on that particular dilemma, I thought I might take a little time to expound (a little) on the benefits of developing a backup and redundancy policy. This is just a fancy way of me trying to encourage other writers to take the time to backup their work and ensure it is somewhere relatively safe.

So first off let’s consider offsite storage:

Don’t take your work for granted. If you’re a writer, a creative professional, or just have work that you do in your spare time which you value — don’t take it for granted that where you store your files locally is ever safe. As experience has recently taught me, anything can happen. In my case it was a simple mistake of plugging in the wrong power adapter to my external hard drive. I can only imagine other scenarios where data might be lost through carelessness, neglect, or by accident/design.

Second, if you value your work or value the time you invest into your work, consider investing a little bit of cash into offsite (typically online) data storage. Here is a brief list of services which others have recommended and which I am currently investigating (descriptions lifted from their sites):

  1. SyncToy by MicroSoft - a free PowerToy that provides an easy to use, highly customizable program that helps users to do the heavy lifting involved with the copying, moving, and synchronization of different directories. Most common operations can be performed with just a few clicks of the mouse, and additional customization is available without added complexity.
  2. Mozy - a simple and safe way to back up all the important stuff on your computer. A copy of your data is stored in a secure, remote location for safekeeping, so that in the event of disaster your data is still retrievable.
  3. XDrive - the best alternative to other storage devices. Get easy backup and more secure storage with protection for your precious files. And all of this without the worry of losing or damaging a piece of hardware.

Caveat emptor: As always, be sure to read the EULA (end user licence agreement) or the terms of service and privacy policy before agreeing to use any online service. This is important as you need to ensure the rights of your work remain yours while sitting on some remote server. Understand what you or the service provider are responsible for and work accordingly.

Let’s also consider a version control system:

For those who do not get that warm and fuzzy feeling about offline storage services, you may want to consider developing your own backup service. This isn’t particularly easy — as most things to do with backup — but it is not impossible and in the long run, this will go a long way to developing a better sense of security when it comes to your work.

Here’s what you may want to consider when developing a personalized backup system:

A hosting package: The monthly cost of hosting is minimal these days and you can get away with setting up a decent hosting package for the price of a Starbucks Latté and cookie (not including initial setup fees). Here are a couple hosting providers that I have dealt with in the past:

A version control system: Okay, I know I’m on shaky ground here and many of you might be thinking this is overkill or way too technical for you — to be honest, you may be right. But this might also be exactly what you might need.

A version control system like "Subversion" is used by developers (and creative professionals), to create incremental versions of files they are currently working on. The most typical use is for code files (HTML, CSS, PHP, etc,). But this does not preclude you from using the system for other files (images, text, word docs, etc,). The beauty of a version control system is that is is both offsite and automatically creates versions for you. Not only that, but with most version control systems you can roll-back to earlier versions of a file (or group of files).

Developer services: setting up a version control system is not as easy as installing software on your computer, but in most cases you can hire the services of a local developer or alternately ask your service provider to help you set it up. Connecting with the system may require you to install a client, but once you get those components set up (and with some basic training), you should have little problem with backing up your files.

Things to consider

Though I’ve discussed — in general — a couple methods for backing up your files and handling version control, it is nothing without diligence. The lack of diligence is what landed me in this pickle in the first place, and I should know better consider the work I do professionally. It is not an easy thing to develop new habits, but if you are serious about protecting the integrity of your work, it is time well spent. I won’t go into detail about how you should accomplish this — that is up to you — but I can tell you that even if you haven’t lost work recently, you should consider it a dangerous probability. In the end, there are no true guarantees with ephemeral things such as digital files, but you can work to ensure that you minimize the risk of loss or damage.

Further reading

Matt Jadud discusses the topic of backups at length on his blog, which covers some of the more complex issues surrounding backups than I am disposed to exploring at this moment. Most of this was written a few years ago, but the principles there are still valuable.

  • (5) Comments
  • RSS 2.0
  • Share/Save/Bookmark
  • farfromfearless

5 people have left comments

Christina Warren - Gravatar

Christina Warren said:

I’m assuming you accidentally fried your external USB or firewire drive — couple of questions, before you either pay way too much for data recovery or write the whole thing off:

Have you taken the drive out of the enclosure and tried to connect it to a computer? If it’s a laptop drive you can very easily get a ribbon adaptor that will connect the portable drive to a full size IDE or SATA cable/power connection.

If you have tried to connect the drive itself to another computer,
is it get recognized at all?

Have you tried putting the drive in the freezer and then accessing it from the computer?

I ask because if you can actually access the drive, the data might be salvageable using software, rather than being forced to pay $700+ for data recovery.

I like your post! The only thing to be careful of, if using a shared hosting plan for back-up, is that you make sure that’s kosher with the host. Most hosts don’t care (I know mine doesn’t even if they don’t explicitly allow me to use my space the way I do), but they’ll often put provisions in their contracts like the space must be for hosted content and not data back-ups. For a temporary or stop-gap solution, it isn’t usually a problem, but for long-term offsite storage, Amazon’s S3 service (either with JungleDisk or via the command line) is my personal favorite. Mozy isn’t bad, but we had a reader have major issues with his restore (took 12 hours to access his data, he then had to download 100 dmg files to get his data, huge pain: http://www.downloadsquad.com/2007/11/19/whats-your-offsite-backup-solution-ask-dls/).

(former computer technician/remaining computer geek)
– Christina

Posted on: January 21, 2008 at 8:46 pmQuote this Comment
Chris Murphy - Gravatar

Chris Murphy said:

Hi Christina, thanks for the hint about Amazon’s S3 — I’m looking into it today for some of my personal files. I also have subversion setup on my domain now, so I’m going to start migrating my theme work and dev work to SVN. As for my HD, it’s an IDE drive so I was able to plug it into my desktop system to trouble shoot it. I’ve also attempted connecting it through different enclosures with no success. But what I did find curious was the fact that the original enclosure that it was “fried” in was still functioning quite well. After some tests, it appears that it is the actual drive that is problematic. It isn’t powering up, which means the control board is toast. It appears that I’m either going to have to attempt swapping control boards from another drive (same make & model) or digging a small grave in my frozen backyard.

*Prays for a small miracle*

Posted on: January 22, 2008 at 9:56 amQuote this Comment
Christina Warren - Gravatar

Christina Warren said:

Chris,

Ouch - yeah, that actually makes sense - I guess because the drive was what was overloaded, not the enclosure. Still, ouch! Best of luck, dude - yeesh. We’ve all been there. And not that it helps anything AT ALL, but it usually just takes one instance like this to make a person back-up conscious for life (I’m still lamenting the e-mail loss of 2000 that took 3.5 years of e-mail and the MP3 Meltdown of 2002 that took half my collection (and it happened literally the month before I bought my first iPod).

I like Amazon’s S3 A LOT — you can even host SVN stuff there (though if your web server can do it, I’m sure that would be easier). I keept stuff backed up to an external local drive but for important folders, I have them tagged to automatically upload to Amazon at night (using the command line and Apple Script, but something identical could be written for Windows) once a week.

Posted on: January 22, 2008 at 11:40 pmQuote this Comment
Chris Murphy - Gravatar

Chris Murphy said:

I’m slowly accepting that my drive is gone for good — Its quite upsetting, but as you’ve pointed out , it’s also a lesson learned. Thankfully it wasn’t my MP3 collection or my e-mail, so I can breathe a little easier.

I did ask my friend, Jon Snook, to hook me up with SVN and it is a feature on the hosting package, so I’ve backed up all of my development files (and writing files) to SVN and I can breathe a little easier now that I know my recent work is relatively safe — especially my themes.

I’m going to look at S3 this weekend and see if it’s a good fit. FYI XDrive is a POS to register with — a co-worker tried it out and the registration process crapped out on him, seemingly unable to handle postal codes outside of the US. I should send them a note.

Posted on: January 23, 2008 at 12:32 pmQuote this Comment
Martin Weiss - Gravatar

Martin Weiss said:

I’ve recently bought myself a Drobo, which is basically a 4 drive harddisk box, that automatically makes backups of whatever is on it. In case of a drive failure, you just put in a new disk, and all your data remains intact, and backed-up.

I do a lot of graphic/video work, and there a remote backup is just not (yet) feasible.

And on really, really important projects, I make an extra backup on a little portable LaCie disk, and take that one home.

Lovely theme you have made here for WP. Congratulations.

Posted on: March 7, 2008 at 7:30 pmQuote this Comment

Leave a Comment-

Comment Guidelines: Basic XHTML is allowed (a href, strong, em, code). All line breaks and paragraphs are automatically generated. Off-topic or inappropriate comments will be edited or deleted. Email addresses will never be published. Keep it PG-13 people!

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>

All fields marked with "*" are required.