[SATLUG] Open Source deduplication capabilities?

Brad Knowles brad at shub-internet.org
Sun Jun 15 17:39:53 CDT 2008

On 6/15/08, John Pappas wrote:

>                                        IMHO, dedupe is the only way to bring
>  offsite data replication within reach of any SMB where bandwidth is the
>  bottleneck.

Anyone seriously considering de-duplication technologies should look 
at the series of articles at 
<http://www.backupcentral.com/content/view/175/1/> written by Curtis 
Preston (author of the O'Reilly books "Unix Backup & Restore", the 
2nd edition "Backup and Restore" which covers Unix and Unix-like OSes 
as well as others, and "Using SANs and NAS").

>             The DD stuff is both super slick and super expensive.  Another
>  option is Digisense.  They are building a dedup into their next offering,
>  but not sure how robust it will be.

Keep in mind that a lot depends on the kinds of other tools you're 
using.  For example, in a TSM "incrementals forever" type of 
environment, the fact that you're taking only incremental backups 
means that you're effectively doing a lot of de-duplication on the 
input side, and further de-duplication is not likely to buy you as 
much.  See <http://www.backupcentral.com/content/view/136/47/>.

Brad Knowles <brad at shub-internet.org>
LinkedIn Profile: <http://tinyurl.com/y8kpxu>

More information about the SATLUG mailing list