numcodecs-rs

This repository provides a compression codec API in Rust inspired by the numcodecs Python API.

The repository is structured as follows:

• crates: Fundamental compression API crates
  • numcodecs: Rusty compression codec API
  • numcodecs-python: Rust bindings to the numcodecs Python API, which allows Python codecs to be used in Rust and Rust codecs to be used in Python
  • numcodecs-wasm-guest: Export a Rust codec as a WebAssembly component when compiling to WebAssembly
  • numcodecs-wasm-builder: Compile a Rust codec into a WebAssembly component using numcodecs-wasm-guest
  • numcodecs-wasm-logging: A codec wrapper that enables logging when compiled to WebAssembly
• codecs: Codec implementation crates, some new, some adapting existing numcodecs codecs with a more composable API
• py: Python packages that expose the compression codecs
  • numcodecs-wasm: Load a WebAssembly component into a Python class implementing the numcodecs Python API
  • numcodecs-wasm-template: Template for a Python package that exports a WebAssembly component as a Python class implementing the numcodecs Python API
  • numcodecs-wasm-materialize: Build Python packages for the codecs implemented in this repository by compiling them to WebAssembly components using the numcodecs-wasm-builder and creating packages using the numcodecs-wasm-template

License

Licensed under the Mozilla Public License, Version 2.0 (LICENSE or https://www.mozilla.org/en-US/MPL/2.0/).

Funding

The numcodecs-rs repository has been developed as part of ESiWACE3, the third phase of the Centre of Excellence in Simulation of Weather and Climate in Europe.

Funded by the European Union. This work has received funding from the European High Performance Computing Joint Undertaking (JU) under grant agreement No 101093054.