Data compression: workplan
Data compression projects
Current projects in this initiative include:
Workplan zlib-rs
Work on zlib-rs is in progress. An audited release is available.
Project status
| status | funding target | funded |
|---|---|---|
| in progress | € 250.000 | 62% |
We're seeking funding for Milestone 3, that completes our implementation. Please get in touch with us, if you are interested in financially supporting memory-safe zlib.
We offer technical support services for organizations wanting to adopt zlib-rs.
Upcoming milestones
Milestone 3: Complete release, packaging and adoption
- Performance work: performance work for various platforms, e.g. algorithmic improvements and using avx512 instruction
- Implementation of remaining API functions: implement remaining functions that must be provided to be a complete drop-in replacement, see this issue
- Audit: a third party security audit
- One year of maintenance
- Packaging & adoption: support adoption and provide packages for Debian
Status: Pending funding. Requested funding €95.000.
Future work
Milestone 4: Above par performance
- further performance optimizations
- implementent improved codegen for state machines
See past milestones.
Workplan zstd
zstd milestones
- a rust crate that implements decompression and multi-threaded compression, and can be integrated with the rust
zstdcrate. - a dynamic library: the
libzstd-rsdynamic library defines an interface identical tolibzstd, and is a drop-in replacement for that library.
We're currently seeking funding to start the project. Please get in touch with us, if you are interested in financially supporting the development of memory-safe zstd.
Project status "zstd"
| status | funding target | funded |
|---|---|---|
| pending funding | € 200.000 | 0% |
Workplan bzip2-rs
Work on bzip2-rs is in progress. The project aims to provide a memory-safe implementation of bzip2 with on-par performance compared to C/C++ counterparts.
Project status
| status | funding target | funded |
|---|---|---|
| in progress | € 30.000 | 100% |
In-progress milestones
Milestone 1: Memory-safe bzip2
- a rust crate that implements bzip2 encoding and decoding, and can be integrated with the rust
bzip2crate. - a dynamic library: the
libbz2-rsdynamic library defines an interface identical tolibbz2, and is a drop-in replacement for that library. It produces byte-for-byte identical output for identical input. - a binary: the
bzip2binary is written in safe rust and provides bzip2 (de)compression functionality on the command line.
Status: In progress. Kindly funded by NLnet Foundation.
Future milestones
Milestone 2: On-par performance
Workplan xz
XZ milestones
- a rust crate that implements multi-threaded compression and decompression, and can be integrated with the rust
xz2crate. - a dynamic library: the
liblzma-rsdynamic library defines an interface identical toliblzma, and is a drop-in replacement for that library.
Project status "xz"
| status | funding target | funded |
|---|---|---|
| pending funding | € 100.000 | 0% |
<< Back to initiative: Data compression