Opened 13 months ago

Closed 13 months ago

Last modified 9 months ago

#5239 closed enhancement (fixed)

zstd-1.5.5

Reported by: Xi Ruoyao Owned by: Bruce Dubbs
Priority: normal Milestone: 12.0
Component: Book Version: git
Severity: normal Keywords:
Cc:

Description

New patch version.

Change History (4)

comment:1 by Xi Ruoyao, 13 months ago

This is a quick fix release. The primary focus is to correct a rare corruption bug in high compression mode, detected by @danlark1 . The probability to generate such a scenario by random chance is extremely low. It evaded months of continuous fuzzer tests, due to the nb and complexity of simultaneous conditions required to trigger it. Nevertheless, @danlark1 from Google shepherds such a humongous amount of data that he managed to detect a reproduction case (corruptions are detected thanks to the checksum), making it possible for @terrelln to investigate and fix the bug. Thanks ! While the probability might be very small, corruption issues are nonetheless very serious, so an update to this version is highly recommended, especially if you employ high compression modes (levels 16+).

When the issue was detected, there were a number of other improvements and minor fixes in the making, hence they are also present in this release.

Change Log

  • fix: fix rare corruption bug affecting the high compression mode, reported by @danlark1 (#3517, @terrelln)
  • perf: improve mid-level compression speed (#3529, #3533, #3543, @yoniko and #3552, @terrelln)
  • lib: deprecated bufferless block-level API (#3534) by @terrelln
  • cli: mmap large dictionaries to save memory, by @daniellerozenblit
  • cli: improve speed of --patch-from mode (~+50%) (#3545) by @daniellerozenblit
  • cli: improve i/o speed (~+10%) when processing lots of small files (#3479) by @felixhandte
  • cli: zstd no longer crashes when requested to write into write-protected directory (#3541) by @felixhandte
  • cli: fix decompression into block device using -o (#3584, @Cyan4973) reported by @georgmu
  • build: fix zstd CLI compiled with lzma support but not zlib support (#3494) by @Hello71
  • build: fix cmake does no longer require 3.18 as minimum version (#3510) by @kou
  • build: fix MSVC+ClangCL linking issue (#3569) by @tru
  • build: fix zstd-dll, version of zstd CLI that links to the dynamic library (#3496) by @yoniko
  • build: fix MSVC warnings (#3495) by @embg
  • doc: updated zstd specification to clarify corner cases, by @Cyan4973
  • doc: document how to create fat binaries for macos (#3568) by @rickmark
  • misc: improve seekable format ingestion speed (~+100%) for very small chunk sizes (#3544) by @Cyan4973
  • misc: tests/fullbench can benchmark multiple files (#3516) by @dloidolt

comment:2 by Bruce Dubbs, 13 months ago

Owner: changed from lfs-book to Bruce Dubbs
Status: new → assigned

comment:3 by Bruce Dubbs, 13 months ago

Resolution: → fixed
Status: assigned → closed

Packages fixed at commit efd83dba4f2dc17a0f70fb86879eb3e28e307745 

    Update to vim-9.0.1452.
    Update to iana-etc-20230405.
    Update to zstd-1.5.5.
    Update to Python-3.11.3.
    Update to meson-1.1.0.
    Update to man-pages-6.04.
    Update to linux-6.2.11.

comment:4 by Bruce Dubbs, 9 months ago

Milestone: 11.4 → 12.0

Milestone renamed

Note: See TracTickets for help on using tickets.