Ask Leo!

What's an incremental backup?

Home » General Computing » Maintenance and Backup

Summary: Backing up is important, but terms like "full", "incremental" and even "differential" can easily confuse. We'll look at what these terms mean.

I have a mental 'block' on backing up which unnerves my approach to it. I have managed one full backup (32gb) on an external hard drive. I have just read your article on maintenance but do not understand what is meant by incremental backup. Does it simply 'update' or overwrite the existing backup or does it create something else that only contains whatever is new since the previous backup? I think the latter is what I would prefer.

There are actually typically three different types of backups: full, incremental, and differential. Understanding which is which, and how they should be used it pretty important to making sure you're appropriately backed up while not simultaneously eating up disk space at an exorbitant rate.

A full backup is just that: full. It's a backup of everything. A "full backup of C:" for example would be a backup of all the files folders and contents of the C: drive. A full backup of "your system" might include the entire contents of all the drives connected to your system.

The important thing is that a full backup stands alone; it's a snapshot of your machine at a particular point in time. You might choose to restore files from that snapshot, or even restore the entire machine to the exact state it was in at the time that snapshot was taken.

Pro: a full backup stands alone; it has everything.

Con: a full backup can be big; it has everything.

"... a full backup stands alone; it's a snapshot of your machine at a particular point in time."

An incremental backup includes only those things that have changed since the previous backup and saves those things into a separate, additional, backup file or location. By definition, the first incremental backup is a full backup; it backs up everything since there's no "previous backup" to compare to. The second incremental backup backs up only those files that have changed since the previous backup was taken.

Since the vast majority of files on your machine actually never or rarely change, an incremental backup can result in a much smaller backup. On my machine, a full backup is about 50 gigabytes, but the incrementals vary from as little as 2.5 gigabytes to around 10, depending on how much happened on the machine that day.

The cost of using incremental backups is one of management. Since each incremental backup relies on the backup that preceded it, in order to restore a machine to an arbitrary point in time all the incremental backups must be available to perform the restore. For example, I perform a monthly full backup and then a daily incremental. If I want to restore my machine to a point in time 10 days into that month, then I need the initial full backup plus the 10 incremental backups to reach that day. Each incremental backup must be restored "on top of" the backup prior until the 10th has been processed.

The good news is that most backup software actually makes this very easy, almost transparent. Typically, you point the software at the collection of backups - both full and incremental - and tell it "I want to restore to this date" and the complexity is managed for you.

Pro: significantly less disk space used compared to an equivalent set of full backups.

Con: the baseline full backup and all the incremental backups must be preserved and available in order to restore.

Differential backups are a kind of hybrid. In reality they're just incremental backups, but with a fixed starting point. Rather than backing up only the changes from the previous day, each differential backup includes all the changes from the baseline full backup. So day 2's backup would include changes from day 1 to day 2. Day 3's backup would include changes from day 1 to day 3.

Pro: Each day can be restored from only two backups, the initial full plus that day's differential.

Con: Differentials only to grow in size from day to day.

Let's compare backing up a "C:" drive. This table shows what each type of backup would include on a series of successive days:

Day Full Incremental Differential
1 Entire Drive Entire Drive Entire Drive
2 Entire Drive Changes since day 1 Changes since day 1
3 Entire Drive Changes since day 2 Changes since day 1
4 Entire Drive Changes since day 3 Changes since day 1
5 Entire Drive Changes since day 4 Changes since day 1
... Entire Drive Changes since the day before Changes since day 1

Now let's look at restoring data. This tables shows which of the backups above must be available in order to restore to a specific day:

Restore to Day Full Incremental Differential
1 Full backup from day 1 Full backup from day 1 Full backup from day 1
2 Full backup from day 2 Full backup from day 1
+ day 2 incremental
Full backup from day 1
+ day 2 differential
3 Full backup from day 3 Full backup from day 1
+ day 2 incremental
+ day 3 incremental
Full backup from day 1
+ day 3 differential
4 Full backup from day 4 Full backup from day 1
+ day 2 incremental
+ day 3 incremental
+ day 4 incremental
Full backup from day 1
+ day 4 differential
5 Full backup from day 5 Full backup from day 1
+ day 2 incremental
+ day 3 incremental
+ day 4 incremental
+ day 5 incremental
Full backup from day 1
+ day 5 differential
... Full backup from day ... Full backup from day 1
+ all incrementals to day ...
Full backup from day 1
+ day ... differential

The choice of what kind of backup to use can seem somewhat daunting. Daily full backup seem like the simplest, and yet you'll quickly find yourself running out of disk space. Incrementals seem like a great alternative, but you could find yourself in backup management hell as you try to keep track of which files you need to keep for how long. And differentials seem like an interesting idea, but then are they really all that different than incrementals?

Here's my suggestion:

  • Periodic full backups. I do a full backup once a month. I actually save these full backups for "a while", so that if I need to find something from, say, three months ago, I might be able to recover it from an old backup.

  • More frequent incremental backups. I do a nightly incremental backup. As the month goes on, I accumulate a collection of incremental backups in addition to that monthly full that will allow me to revert or recover from any day in the month. Once a month I "clean the slate" as a new full backup is taken.

Why not just do a nightly full backup and allow it to overwrite the previous day's backup? You could, but ... you're assuming that you'll always detect a problem or a missing file within a day, before the backup containing it is overwritten. Experience shows that things don't work that cleanly. It's not at all uncommon to wonder days, sometimes months later, "where did that file go"? Being able to search your daily backups for a file that might have disappeared can often be a real lifesaver.

Finally, don't let all this intimidate you into not backing up at all. Most backup programs make these choices fairly easy, and will do a good job of managing the backup files for you. In my case, for example, after configuring Acronis TrueImage Home, I actually don't even think about my backups more than about once a month, and even then it's only to decide if I want to save the most recent monthly full backup for posterity.

Other than that, everything's completely automated.

Computers are good at that.

Related:

Article 12625 | Posted August 23, 2008

Recent Comments
10 Comments

Dummies guide to backup. I like. Now i only need dummies guide to bare metal restoration.

I am trying out Acronis but i couldn't figure out if in respect of data files it could copy ONLY the changed files and copy them OVER the respective previous versions of those files so that:
a) the backup is exact replica of the original (i.e. same size uncompressed, same folder structure); and
b) every day it backups only the changed files so that the process doesn't take time.

Currently, I am achieving the same through Briefcase utility (tho it has some limitations) and through Cobian's differential backup, but uncompressed unencrypted. It won't overwrite older files if you use compression.

Posted by: novice at August 23, 2008 2:51 PM

Thank you for this article it is timely. I am operating Windows Vista Basic Home. I attempted backup files at the urge of a warning. The back up did not complete. I cleared files. I don't know what else to do. However, since the attempt at backup; I have not received anymore warnings.

Posted by: DeeJ at August 26, 2008 10:13 AM

Thanks Leo - that is the clearest explanation of the three types of backup that I have ever read. I have read many and most have left me confused and none the wiser.

Posted by: Tony Starkey at August 26, 2008 11:02 AM

Avery good defination and explanation of Back-up
structure. Very well explained. Worth Saving for future reference. Thanks.

Posted by: Dave at August 27, 2008 2:06 AM

A bit complicated for me Leo.
I do a monthly backup in XP by just burning the Documents and Settings folder to a DVD, it follows that I get all my documents, music, pictures,outlook express [.dbx files] folders on disc. I reckon that most people would be able to fit everything on one DVD.
It's re-assuring to know that you have all your important files kept safely.

While I'm happy that you're doing something (which is, sadly, more than most people), I do want to take exception with one statement you make:

"It's re-assuring to know that you have all your important files kept safely."

Except that you don't.

"Documents and Settings" is important, don't get me wrong, but it is not everything. For example if you were to lose your hard disk you would have to reinstall Windows from scratch, reinstall all your applications from scratch, re-customize those applications from scratch (those "settings" are typically NOT in "Documents and Settings"), and it's likely that there are programs you run that keep documents in places other than "Documents and Settings".

I, personally, feel that backing up only "Documents and Settings" is not nearly enough. Better than nothing, but still ... not enough.

-Leo

Posted by: Chris Faulkner at August 27, 2008 5:19 AM

very good information. It cleared all my doubts. Thanks so much...
Harish
http://indexviews.blogspot.com/

Posted by: Harish at August 28, 2008 9:24 AM

ya, itz very nice and helpful to me, i know some thing only abt backup and i know the words of incremental, full, differential and don't know full.. not i can feel i knew that too.. so thx.

Posted by: nani at September 6, 2008 12:22 AM

Hey Leo,

I've been looking everywhere for a solution that goes like this:

-Full backup beginning on Sunday

-Incremental Backups Monday->Saturday

-On the Following Sunday, my incremental backup from Monday gets merged with my Full Backup, thus creating an "updated" Full Backup.

Effectively, this will give me a week's worth of incremental backups, and a Full backup that's always a week old. This way, if I lose something on Saturday night, and don't realize it till Monday, my full backup won't have been replaced with the latest files from Sunday's Full Backup. Do you know of any programs that do this?

Thanks!

Posted by: Jim at September 6, 2008 10:01 PM

I can't backup my computer. There's too much to put on a DVD. What's my solution? I need to backup before I install XP3.

It depends on exactly how you backup. A good backup program will automatically let you backup to multiple CDs or DVDs.
-Leo

Posted by: Claire Gehrett at September 8, 2008 8:50 PM

THANK YOU. Wow. I've taken two A+ classes that have gone through this, read through sections in 3 different books, but your article completely clears it up for me! Thanks so much for this article. The different backup types can be confusing because (as you said yourself) they SOUND similar, and that's where the confusion starts. Thanks again

Posted by: jake at October 30, 2008 2:09 PM

Post a comment on "What's an incremental backup?":






(Email Address will not be published.)

Remember Me?

By popular demand...
my tip jar
Cuppa Joe
Buy Leo a Latte!

(you may use HTML tags for style)

New!

RSS feed Subscribe to the RSS Feed specifically for comments on this article.

Before commenting, please...

Please wait. Your comment is being processed ...


Ask Your Question:


ask-leo.com
Web

Stay Informed

Weekly Newsletter

Archives

By Category
By Date

Advertisers

Advertise on Ask Leo!

««   »»

Question? - Ask Leo!
Who is Leo?
Link to Leo!

Terms, Conditions & Privacy