[Bug 1648709] New: Review Request:
python-indexed_gzip - Fast random access of gzip files in Python
by bugzilla@redhat.com
https://bugzilla.redhat.com/show_bug.cgi?id=1648709
Bug ID: 1648709
Summary: Review Request: python-indexed_gzip - Fast random
access of gzip files in Python
Product: Fedora
Version: rawhide
Component: Package Review
Severity: medium
Priority: medium
Assignee: nobody(a)fedoraproject.org
Reporter: sanjay.ankur(a)gmail.com
QA Contact: extras-qa(a)fedoraproject.org
CC: package-review(a)lists.fedoraproject.org
Spec URL:
https://ankursinha.fedorapeople.org/python-indexed_gzip/python-indexed_gz...
SRPM URL:
https://ankursinha.fedorapeople.org/python-indexed_gzip/python-indexed_gz...
Description:
The indexed_gzip project is a Python extension which aims to provide a drop-in
replacement for the built-in Python gzip.GzipFile class, the IndexedGzipFile.
indexed_gzip was written to allow fast random access of compressed NIFTI image
files (for which GZIP is the de-facto compression standard), but will work with
any GZIP file. indexed_gzip is easy to use with nibabel.
The standard gzip.GzipFile class exposes a random access-like interface (via
its seek and read methods), but every time you seek to a new point in the
uncompressed data stream, the GzipFile instance has to start decompressing from
the beginning of the file, until it reaches the requested location.
An IndexedGzipFile instance gets around this performance limitation by building
an index, which contains *seek points*, mappings between corresponding
locations in the compressed and uncompressed data streams. Each seek point is
accompanied by a chunk (32KB) of uncompressed data which is used to initialise
the decompression algorithm, allowing us to start reading from any seek point.
If the index is built with a seek point spacing of 1MB, we only have to
decompress (on average) 512KB of data to read from any location in the file.
Fedora Account System Username: ankursinha
Koji scratch build:
https://koji.fedoraproject.org/koji/taskinfo?taskID=30810729
--
You are receiving this mail because:
You are on the CC list for the bug.
You are always notified about changes to this product and component
5 years, 7 months