Photography Technology Video

The Complete Photo and Video Media Backup Workflow

Media Import and Backup Workflow

Disclosure: There are some affiliate links below, but these are all products I highly recommend. I won’t put anything on this page that I haven’t verified and/or personally used.

Click here to view our updated version of this post for 2023

 

 

My video production business generates a TON of data each week and keeping track of it used to keep me up at night. We’re talking actual nightmares about losing a project to harddrive theft, failure, etc.

Over the years we’ve had several hard drive failures and even a hard drive getting knocked off a table. Using this workflow in this post, I’ve been able to prevent the loss of critical data and client projects every time.  Whether you’re considering this for a video or photography backup workflow I hope this guide gives you the tools you need to never have to experience data loss from theft or drive failures.

It’s one of the least exciting parts of the job, but one of the most important. It’s something that anyone with client projects and data should understand: importing, storing, and backing up your precious media.

This workflow is geared towards anyone who creates digital media (photo, video, graphic, etc) and is easily scaled to grow with your media and budget for storage.

Of course, what you’re about to read isn’t the only way to do this. For some creatives, it may be using just passport drives – for others, it may be RAID arrays or large networked storage arrays. Either way, the basics remain the same and scale accordingly for storing photos and storing data. Among the many work-related bad dreams I’ve had, losing footage is one of the worst.

What we’ll cover

Backup Basics

Media Storage Basics

My bullet-proof workflow

TL;DR Tools to consider

Hedge – Checksum Ingest Software

Kyno – Media Management App

 

Backup and Storage Basics

1. Be organized.  The weakest point of a workflow is going to be at the import.  Ideally, when on larger sets you hire a DIT to manage your media, but that’s not always possible. When you’re on location with a client, be sure you have a good system in place to make sure that all your cards are 1) marked and not going to be overwritten and 2) not forgotten about.

A long time back, I was filming a client project and one of my camera operators had already started filming on one of his memory cards before I gave him one of ours to use. I gave him one of mine to use instead and asked for the one he had been shooting on. He had stuffed it in his pocket… with several other cards, which several fell out when he went to pull out the one. He didn’t even know which card had been used. Please don’t ever do that. Get a card case of some kind and have a system.

I have two Pelican 0915 SD Card cases, one with green paper tape (safe cards) and one with red tape (used cards). As soon as a card comes out of a camera, I immediately use a red strip of paper tape, write the card name/number on it, and cover the contacts. It goes right into the red case, which is then secured with me for the rest of the shoot. There are a number of ways to do this well, but this method gives me the most confidence.


2. Make redundant copies. A common mistake is to make only one copy of your media and then duplicate that copy to other drives. If there happened to be any issues with the transfer, you’ve now duplicated that issue to all your copies.

I use Hedge (10% off with this link!), an all-in-one media backup suite made for video. (It works for any kind of transfer though) It’s built around best-practices for media backup, including making individual copies to each attached drive, high-speed transfers, and media verification through check-sums.  The reality is that hard drives will eventually fail, and you don’t want to find yourself with no backup copies. If you’re using something like Offload from RedGiant, your mind will be blown by the speed you get out of Hedge.

3. Keep a clean copy of your media. Before you start transcoding media or dropping it into any software, make sure to keep an unaltered copy of the media.  If you run into any issues with transcoding, make a mistake, or your proprietary software alters something, you want to make sure you can start fresh.

4. Keep everything separate. We work from the concept of 2+1 for the number of copies we make at a minimum – by the time we are done with a project, we usually have 4 or more copies. Two copies that live here at the office (one for editing, one on a backup drive) and then a third copy that is kept off-site.  This helps protect you from not only drive failures but also the less likely scenarios such as break-ins or physical property damage from fire or weather.  If you have a RAID array on site, that can act as your redundant on-site backup – just make sure you have something stored off-site as well. We also use cloud storage through G Suite as another form of backup for extra peace of mind.

5. (Bonus) Never leave hard drives where they could get stolen

In fact, don’t leave ANYTHING that makes you money unattended (especially in a car) where someone could break in and steal it. After a shoot, keep your cards safe and ingest them as soon as possible.

If you’re traveling, bring an extra harddrive that you can make a copy to and then ship that home. If your bags get lost or stolen, you’ll have a backup waiting for you when you get home.

Media Storage Basics

The cost of hard drives and digital media has dropped dramatically over the years. I almost never delete footage because hard drives are cheap enough to just budget in new drives with each project.

Copy Software: While using your OS’ file browser to transfer files gets the job done, it offers little protection against errors, whether human or technical. The best addition in the past year to my software toolkit is Hedge, a tool that handles simultaneous backups AND performs Check-Sum verification of your drives. Check-Sum verification is a foolproof method of ensuring that what was on that memory card, is now on your hard drive.

Hard drives: Not all hard drives are created equal! Even with a good backup strategy, it’s key to use drives that aren’t going to force you to test your strategy often. For field drives, I exclusively use La Cie Rugged drives which offer a high level of protection from bumps, spills, and drops. For long-term storage, I recommend a combination of a RAID array (we’ll get to that later) and external high performance passport drives (usb 3.1 drives are recommended).

Online Backup:  First note – Online backups are NOT a replacement for multiple hard drive backups. You never know when a service might shut down, have a catastrophic failure, lose data, etc.  I use two different backup services for our data transfers. Our main RAID is automatically backed up to BackBlaze, which provides unlimited data backups, and most importantly, backs up external drives. (External drives must be connected every 30 days, otherwise, the backup is deleted). This gives the peace of mind that your most important work is being continuously and automatically backed up.

The second backup service we use is Google Drive, specifically through G Suite. G Suite is Google’s business-focused email, file, and management system, which basically gives your business a branded version of Gmail and associated tools. (If you’re still using an email that ends in @Gmail.com, it’s time to move to a branded domain name anyway.)  The Business edition of G Suite ($10/mo/user) offers unlimited data storage and a desktop application that you can easily upload your files with. Whenever we ingest a project, it’s added as a source in Hedge (read more about that below) and it’s backed up online. You can sign up for a business plan here.

 

The bullet-proof ingest and backup workflow

At the end of a long day of shooting, there’s still the chore of ingesting your media and properly backing it up.  In this section, I’ll walk you through each step of my process.

1. Memory Cards

The foundation of keeping your media safe starts with using good media cards.  It may be tempting to use the $10 SD card you found online or on the shelf at the store, but you really need to invest in quality cards that are reliable and fast enough to handle your camera’s write speed.  I see people post on Facebook groups frequently about weird lines and artifacts in their video files and asking for help with fixing it- unfortunately, that is usually a result of a card that was too slow for the camera or a failing card and there is no fix for that. Also beware of counterfeit memory cards on online stores! My favorite brand of cards is the SanDisk Extreme Series which handles most of the cameras in my kit.  Now if you’re getting up into high-end cameras, be sure to check the specs of what you need as those cards can easily be several hundred dollars, but the same concept applies.

2. Card Readers

Depending on your computer setup, the availability of multiple USB ports may be limited. Using my MacBook Pro, I got pretty tired of only being able to import one card at a time, so I purchased an Anker 4-port USB hub and multiple card readers to increase my ability to import up to 4 cards at once.  Now if you want a less DIY solution, you can pick up a dedicated 4-Bank Lexar Reader Hub for under $80.

3. Storage Media

Since this can vary so much by the size of your operation and budget, I’ll keep this basic (using passport hard drives as an example) since the concept scales up to more complicated RAID arrays and network storage methods.

Make sure to get quality hard drives and don’t always go with the cheapest option. While Passport drives are cheap, consider getting a desktop drive that has a more quality internal HDD.

I typically try to stick with Western Digital. I shared the link about hard drive failure rates above, but it’s worth sharing again – Hard Drive Failure Rates – BackBlaze.

Always, always, always make multiple copies of your data. You should at least have two copies and then a third off-site. That could look like having a copy on your computer for editing, a backup copy on an external drive, and then the third hard drive at home. Always keep a clean, unmodified set of your files and be careful using editing programs to run your backups because they could be changing file data in the process.

Now at a more complex setup considering a drive for video editing, I’d recommend having a Drobo RAID as the primary backup destination, then having a passport drive as a secondary backup somewhere safe at the office. I have a 4TB Lacie Rugged Drive which I use to shuttle projects home where I keep my off-site backups on a hard drive.

Our office has gigabit internet, so everything gets uploaded to our Google Drive as a backup to the backups. You’ll need their middle-tier subscription for unlimited space.



3. Import Software

For several years, I relied on Finder to copy cards to hard drives but that resulted in a few times where it would have errors and I never felt completely confident in how it transferred the media. Getting into editing a few weeks after clearing your cards and finding out a file was corrupted is terrible, especially if it’s something really important like an interview.  I was elated when Hedge Backup Software (10% off with this link!) launched a few years ago because it completely handles the backup workflow in a very simple and secure way. Hedge uses Checksum verification, which examines the original media file and then the copy and ensures that they are exactly the same which eliminates the potential of finding corrupted files later on. Furthermore, it creates a unique copy of every file on each copy destination giving extra security.  Hedge is the fastest software solution I’ve ever used and it’s the cornerstone of my backup system.

Using Hedge is as simple as dragging your media cards to “Sources” and your hard drives to “Destinations”. Be sure to use good naming schemes with your cards to keep everything organized. Everyone has their own system in place for what works for their studio and team. For us, we typically use the camera name, card number, and then which camera it was, so that looks like A01_C300 (Camera A, Card 01, Camer from the C300).

Once you hit “Start Transfers, Hedge gets to work importing and verifying your media. It will show you the time remaining, as well as the transfer speeds to help you find any bottle necks in the transfer process (Slow hard drives, hubs, etc)

Hedge will do it’s thing and you will get a confirmation and the option to eject your media and add new cards!

Hedge also has introduced several new integrations to further help improve your post-production workflow. My favorite free add-on was the introduction of ParaShoot. ParaShoot will automatically check to make sure that card is fully backed up (another layer of security) and then “erase” the memory card.  The cool part here is that it doesn’t actually delete any data. Rather it just scrambles a few things in the card’s header file, so that your camera will force you to format the card in-camera. If I pop a new card into my camera and don’t see the format note, I know something isn’t right.

With this workflow, I have had two hard drive mishaps over the years – one being a client knocking a harddrive off the table and the other one a complete drive failure. Hearing the clicking sound from a bad hard drive was horrifying, but no data was ultimately lost because I had proper backups that I could pull from.

And finally for the list of gear mentioned in this post:














Leave a Reply

You may also like

Business Inspiration

13 Great Business Ideas for Creatives

post-image

Are you a creative individual looking to turn your passion into a profitable business? Whether you’re looking to start a side hustle or take the leap into full-time entrepreneurship, there are countless opportunities for creatives to turn their talents into successful businesses. From handmade soap and skin care products to event planning and photography, there’s a business idea for every creative. This blog post will explore 14 business ideas perfect for those passionate about creativity. Whether you’re an artist, writer, designer, or musician, these ideas will inspire you to turn your creativity into a successful business venture. So, let’s dive in and explore some of the best business ideas for creatives!

Business Ideas for Creatives

Photography

Whether it’s wedding photography, portrait photography, or stock photography, there are plenty of opportunities…

Read More
Blogging Business Money

How to start a website for your creative business

post-image

In today’s digital age, having a website is essential for any business to succeed. However, with so many options for site builders and content management systems (CMS) available, it can be overwhelming for creatives to decide where to start. But fear not! Our favorite option for creating a professional and customizable website is self-hosted WordPress.

WordPress is a versatile and user-friendly CMS that enables users to create and manage their own website without requiring extensive technical knowledge or coding skills. The platform offers a vast array of themes, plugins, and templates that can be tailored to meet your specific needs and preferences. Whether you’re starting a blog, e-commerce store, or business website, WordPress has the tools to help you succeed.

Of course, to use WordPress, you’ll need a reliable website hosting service. That’s where SiteGround comes in. SiteGround is a top-rated hosting provider that offers a range of plans to…

Read More
Business Travel

Traveling with gear for photographers and videographers

post-image

Traveling with photography or video gear can be a stressful and strenuous experience. Even for those of us who enjoy a leisurely stroll through the airport, navigating the various checkpoints, lines, and crowds with delicate and often expensive equipment can be a daunting task. With that said, there are ways to simplify the process and ensure that your gear arrives safely and efficiently.

It is important to evaluate what is mission-critical for your trip and make that your carry-on whenever possible. This may mean investing in a sturdy pelican case or camera backpack that fits comfortably under your seat. These carry-ons should contain all the equipment that is essential to the success of your project, as well as any fragile or expensive items that you cannot afford to lose or damage. By prioritizing these items…

Read More
Health Business

Taking a vacation as a freelancer or creative business owner

post-image

When was the last time you really took a vacation as a freelancer? Did you actually take a break, or did you end up worrying about work the whole time?

This past weekend, my wife Melinda and I, took a few days to go to a lake house with her family. It was perfect timing because we were definitely needing some downtime from a busy summer and before she goes back to work (she’s a teacher). It was so great getting away for a few days, trying out wakeboarding for the first time, and being around her family. (For the record, wakeboarding is way more difficult than I thought it would be. I almost got up though!)

I had an out-of-town drone gig that I was leaving for early Monday morning and I had a little bit of work to finish up, so I woke up early the first morning to…

Read More
Business

How to Start a Creative Business from Scratch

post-image

I can’t say that I saw myself not going to work for a studio or corporate America when I graduated from college, but through a few great mentors and friends, I found myself creating something for myself. I was working for a wedding videography company when a friend talked me up to a couple they knew who was getting married. I filmed their wedding for $350. Out of that, I was able to create a business of my own on the side while I worked my 9-5 as an admissions counselor.  Looking back, there are so many things I wish I knew.

Thinking about launching a business, especially if it’s your first time, can be really daunting. There are a lot of things to consider: the risk, personal bandwidth, and well-being – but done right it can give you so much freedom and fulfillment.

1. Observe and plan

I own two video-focused…

Read More
Business Reviews Technology

How to start a podcast

Podcasting is a great way to build a community, share your messaging, and build a brand.

I’ve done podcast launch consulting, editing, and recently helped launch and produce The Buzzer Podcast. Podcasting is a great way to connect with people, so you’ll want to think through how you’re going to build a community and an audience.

Some things to think about:

  • Come up with a creative name and figure out your branding for the podcast.
  • Consider the kind of podcast you’re going to do – will it just be you talking? Will you interview people? Will your guests be interview subjects or co-hosts?
  • Consider your target audience – How will you reach them? How will you keep them engaged?
  • Don’t expect immediate viral success – Building your listenership takes time. Give yourself at least 15-20 episodes to evaluate whether you should continue.
  • Ask yourself if podcasting makes sense for what you’re…
Read More
Money Business

Breaking the cycle of “Feast or Famine” for Creatives

post-image

Over the years, one of the biggest challenges I faced and learned to understand was the seasonality of working in the creative world, something that greatly contributes to the cycle of Feast or Famine.

There were some months I’d be so busy that I could hardly keep up, which were also great months financially. Then others (especially approaching the holidays), where I’d start getting really nervous because there just wasn’t that much work to be had, and often would be financially stressful.

Overcoming the feast or famine cycle doesn’t happen overnight, but it’s possible to smooth it out with intentional strategy and planning.

1. Plan ahead

Once you’ve had a year or two of working in your specific industry, you’ll be able to pick up on trends of seasonality. For example, the wedding world tends to be incredibly busy in the Springtime and fall, but generally slow down a lot around November-January.  Likewise,…

Read More
Business

9 Ways to Avoid and Beat Creative Burnouts

post-image

Most creative entrepreneurs will face creative burnout at some point or many points in their careers. It’s the feeling of disinterest with your work, lacking creativity and motivation, and general exhaustion with work. That mental block that keeps you from pursuing what you love. It’s a something that leaves you drained and your work will suffer.  I found myself facing that early last year, feeling generally disinterested with projects, little motivation to go out and film, and found myself with a growing backlog of work. What I found was many factors all playing together that caused me to burn out with my work.

Here are nine ways to break free from creative burnout (and avoid it):

1. Make time For Creativity

Last year, I found myself lacking a creative drive for a couple months and I no longer had the passion to go create. What I realized was the real issue…

Read More