Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WP - Libraries: Rebuild data storage handlers (ZARR) #15

Open
rflinnenbank opened this issue Jul 3, 2024 · 0 comments
Open

WP - Libraries: Rebuild data storage handlers (ZARR) #15

rflinnenbank opened this issue Jul 3, 2024 · 0 comments
Assignees
Labels
documentation Associated issue or PR changes or adds documentation feature Associated issue or PR is related to a feature or feature change high priority Associated issue or PR is of high priority release Associated issue or PR is part of a larger update

Comments

@rflinnenbank
Copy link
Collaborator

rflinnenbank commented Jul 3, 2024

Data storage handlers are the functions responsible for properly storing and fetching data.

No longer retrieving full files and then filtering them, ZARR allows for targeted retrieval, updating and deletion, depending on the situation. The data storage handlers are there to provider the tools to it for the models.

Scope:
All WP storage related functions for taking full xarray DataSet objects or just singular DataArray objects and transcribing their contents unto or from a ZARR storage cluster. It also includes all methods related to accessing information on available files and the deletion of data)

Finally, this Also includes output format storage. From a xarray Dataset, store into CSV, JSON, JSON (alternate style), NetCDF3 or NetCDF4.

@rflinnenbank rflinnenbank self-assigned this Jul 3, 2024
@rflinnenbank rflinnenbank converted this from a draft issue Jul 3, 2024
@rflinnenbank rflinnenbank added development high priority Associated issue or PR is of high priority release Associated issue or PR is part of a larger update feature Associated issue or PR is related to a feature or feature change documentation Associated issue or PR changes or adds documentation and removed development labels Jul 3, 2024
@rflinnenbank rflinnenbank added this to the 1.0b Beta Release milestone Jul 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Associated issue or PR changes or adds documentation feature Associated issue or PR is related to a feature or feature change high priority Associated issue or PR is of high priority release Associated issue or PR is part of a larger update
Projects
Development

No branches or pull requests

1 participant