zstd-1.5.5

[Xi Ruoyao]

New patch version.

[Xi Ruoyao]

This is a quick fix release. The primary focus is to correct a rare corruption bug in high compression mode, detected by @danlark1 . The probability to generate such a scenario by random chance is extremely low. It evaded months of continuous fuzzer tests, due to the nb and complexity of simultaneous conditions required to trigger it. Nevertheless, @danlark1 from Google shepherds such a humongous amount of data that he managed to detect a reproduction case (corruptions are detected thanks to the checksum), making it possible for @terrelln to investigate and fix the bug. Thanks ! While the probability might be very small, corruption issues are nonetheless very serious, so an update to this version is highly recommended, especially if you employ high compression modes (levels 16+).

When the issue was detected, there were a number of other improvements and minor fixes in the making, hence they are also present in this release.

Change Log

• fix: fix rare corruption bug affecting the high compression mode, reported by @danlark1 (#3517, @terrelln)
• perf: improve mid-level compression speed (#3529, #3533, #3543, @yoniko and #3552, @terrelln)
• lib: deprecated bufferless block-level API (#3534) by @terrelln
• cli: mmap large dictionaries to save memory, by @daniellerozenblit
• cli: improve speed of --patch-from mode (~+50%) (#3545) by @daniellerozenblit
• cli: improve i/o speed (~+10%) when processing lots of small files (#3479) by @felixhandte
• cli: zstd no longer crashes when requested to write into write-protected directory (#3541) by @felixhandte
• cli: fix decompression into block device using -o (#3584, @Cyan4973) reported by @georgmu
• build: fix zstd CLI compiled with lzma support but not zlib support (#3494) by @Hello71
• build: fix cmake does no longer require 3.18 as minimum version (#3510) by @kou
• build: fix MSVC+ClangCL linking issue (#3569) by @tru
• build: fix zstd-dll, version of zstd CLI that links to the dynamic library (#3496) by @yoniko
• build: fix MSVC warnings (#3495) by @embg
• doc: updated zstd specification to clarify corner cases, by @Cyan4973
• doc: document how to create fat binaries for macos (#3568) by @rickmark
• misc: improve seekable format ingestion speed (~+100%) for very small chunk sizes (#3544) by @Cyan4973
• misc: tests/fullbench can benchmark multiple files (#3516) by @dloidolt

[Bruce Dubbs]

Packages fixed at commit efd83dba4f2dc17a0f70fb86879eb3e28e307745

    Update to vim-9.0.1452.
    Update to iana-etc-20230405.
    Update to zstd-1.5.5.
    Update to Python-3.11.3.
    Update to meson-1.1.0.
    Update to man-pages-6.04.
    Update to linux-6.2.11.

[Bruce Dubbs]

Milestone renamed