Results 1 to 6 of 6

Thread: LessFS Pairs De-Duplication With Snappy Compression

  1. #1
    Join Date
    Jan 2007
    Posts
    14,812

    Default LessFS Pairs De-Duplication With Snappy Compression

    Phoronix: LessFS Pairs De-Duplication With Snappy Compression

    Btrfs isn't the only file-system to take advantage of Google's Snappy compression as a speedy means of transparent file compression, but the LessFS file-system has also supported Snappy for the past few months. This open-source file-system also has de-duplication support...

    http://www.phoronix.com/vr.php?view=MTA0MzQ

  2. #2
    Join Date
    Nov 2011
    Posts
    65

    Default

    benchmarks of this vs btrfs, ext4, and SDFS?

  3. #3
    Join Date
    Oct 2007
    Posts
    285

    Default

    Quote Originally Posted by coder543 View Post
    benchmarks of this vs btrfs, ext4, and SDFS?
    I second that!
    However, ZFS should certainly be added to the mix as well

  4. #4
    Join Date
    Nov 2009
    Posts
    379

    Default

    I've read bad bad stories about deduplication (at least in ZFS)

    This seems to be only useful, if you have a kind of data-dump-storage and never change it once created...

  5. #5
    Join Date
    Oct 2010
    Posts
    90

    Default

    Quote Originally Posted by disi View Post
    I've read bad bad stories about deduplication (at least in ZFS)

    This seems to be only useful, if you have a kind of data-dump-storage and never change it once created...
    Which is admittedly quite common - at work, I've got a ZFS/dedup/compression NFS share I use as storage for our project data [1]. The original data is typically left alone, while any modifications of it are done into new files. At home, I've got a storage disk full of assorted media - and that's not exactly often-modified data either. (Consider something like my many GB of RAW photos: Lightroom stores your changes as a list of modifications while leaving the original untouched.)

    [1] Anything hard or impossible to recreate also has backups, of course

  6. #6
    Join Date
    Jan 2012
    Posts
    9

    Default LZ4

    Well, it seems there is an even better alternative than Snappy which is being tested by LessFS :

    http://www.lessfs.com/wordpress/?p=688

    When will we have an article about that on Phoronix ?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •