Version 1.2.0 of Pcompress

Release Notes: This release adds many improvements and fixes, including ones for performance and stability. It adds the KECCAK Sha3 message digest. A new fast Delta variant detects embedded tables of binary numeric data and RLE encodes them. A matrix transform allows better compression of a Dedupe index. LZ4 and XXHash have been updated. The test suite has been expanded. Pcompress now builds without warnings with strict compiler flags. Alternate locations for external libraries are handled properly, and older OpenSSL versions up to 0.9.8e work. The debug statistics mode now prints additional throughput statistics.

Other releases

  •  02 Mar 2014 18:09

Release Notes: This release fixes several important bugs in the 3.0 version, making it more stable. In addition, automatic scaling of compression buffers based on compression level has been added. This improves compression ratio for the simple usage modes.

  •  12 Jan 2014 23:05

Release Notes: This is a major release featuring complete archiving capability using Libarchive and advanced data type-based compression. Appropriate algorithms for the file type are used along with various filters like PackJPG, Dispack, Delta2, etc. Files are sorted to cluster similar content and improve compression. Data split boundaries are determined from file type and rolling hash changes. Other improvements include performance tweaks, reduced memory consumption, and simplified usage.

  •  06 Sep 2013 02:40

Release Notes: This release fixes several issues, including some corner case crashes and a couple of buffer overflows. Data Deduplication can now be done using blocks as small as 2KB, providing a much higher dedupe ratio than virtually any other deduplication software. Similarity based deduplication performance has been improved. Free memory detection accuracy has also been improved.

  •  10 Aug 2013 07:24

Release Notes: This release fixes a few bugs and provides several improvements in efficiency and performance. The Similarity detection effectiveness for similarity based near-exact deduplication has been improved. At the same time memory requirements for the index has been reduced. Accuracy of data partitioning between threads has been improved. Chunking and indexing performance have been improved and the KMV Sketch computation is now more accurate. This release moves all the core functionality into a shared library in preparation for an API interface that will be introduced in future releases.

  •  28 May 2013 21:30

Release Notes: This is primarily a Bugfix release. It fixes some crashes with invalid input and build problems on Debian6 and older non-SSE4 processors. The Min-heap based Similarity matching for Delta Encoding has been improved and made faster and more accurate. Accuracy of scalable Segmented Global Deduplication has been further improved to be greater than 95%. More testcases have been added.


Project Spotlight

JStock - Free Stock Market Software

A stock market application.


Project Spotlight


A .NET library that provides an abstraction over persistent data stores.