Is data deduplication a good way to cut backup times from remote offices?

Is data deduplication a good way to cut backup times from remote offices?

My business wants to cut backup times from remote offices. Is data deduplication a good way to achieve that?

    Requires Free Membership to View

    When you register for SearchStorage.co.UK, you will also receive targeted emails from my team of award-winning editorial writers. Our goal is to keep you informed on the hottest topics, the latest news and the biggest challenges that are unique to your needs as a storage professional in the UK.    

    Rich Castagna, Editorial Director

    By submitting your registration information to SearchStorage.co.uk you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchStorage.co.uk is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

Data deduplication is one way of achieving this but can be prohibitively expensive, depending on how much data there is and the vendor involved. Another method to consider is real-time replication, which can be done on deduplicated data to reduce bandwidth but can equally be done with tools which will only replicate block-level changes.

I am currently running a proof-of-concept on NetVault:Real-Time Data Protector from BakBone Software, and this has proved extremely successful. It also has the added benefit of restoring 'wrapper' files first so that even if a restore is not complete, the file is usable by the end user. The technology can be used many to one, so you don't need a deduplicator at every site as the brains of the operation remain in your data centre.

For more information on deduplication methods, read this Ask the Expert question on inline vs. post-processing data deduplication.

This was first published in July 2009