Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for decompressing multi-member gzip files? #42

Open
ikreymer opened this issue Nov 15, 2021 · 2 comments
Open

Support for decompressing multi-member gzip files? #42

ikreymer opened this issue Nov 15, 2021 · 2 comments
Labels
addition/proposal New features or enhancements needs implementer interest Moving the issue forward requires implementers to express interest

Comments

@ikreymer
Copy link

The GZIP spec includes support for one or more members (A gzip file consists of a series of "members" (compressed data sets).
but this spec currently states A gzip stream may only contain one "member"..

This is a request to be able to support decompressing multi-member gzip files to support use cases that depend on multi-member gzip (such as parsing ISO WARC).

Alternatively, if a way to get the unused data as in #39 would allow the developer to implement this manually, those ideal solution for my use case be native support for a multi-member DecompressionStream.

Could provide a proposed spec if there would be interest..

@ricea
Copy link
Collaborator

ricea commented Nov 16, 2021

Interesting! I didn't know there was demand for this. I can't commit to implementing it, but I would like to see your proposed spec.

@evertheylen
Copy link

I recently had the same problem and made this. It works by inspecting the chunks for potential new streams (using the magic 1f8b08 bytes), splitting when necessary, and re-creating a DecompressionStream when it crashes. Maybe it helps some of you!

@annevk annevk added addition/proposal New features or enhancements needs implementer interest Moving the issue forward requires implementers to express interest labels Oct 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
addition/proposal New features or enhancements needs implementer interest Moving the issue forward requires implementers to express interest
Development

No branches or pull requests

4 participants