Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extraction of a subset to another mth5 archive (export_subset) #219

Open
kkappler opened this issue Jun 28, 2024 · 0 comments
Open

Extraction of a subset to another mth5 archive (export_subset) #219

kkappler opened this issue Jun 28, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@kkappler
Copy link
Collaborator

Context: sometimes my h5 files can get large and I would like to export a subset of the data in the MTH5 to a smaller file that I can share to another user, or transfer over network to another machine. For example, I have a 20GB file, but a few short runs <1GB that I want to share.

It would be nice if I could do something like:

m.open_mth5(file_name)
m.export_subset(other_file_name, dataset_df)
m.close_mth5()

Now I would have a separate mth5 called other_file_name.

It would be ideal if all the metadata cleanly transferred to the new file, and of the input dataframe looked like an mth5 channel summary.
In that case, I could just grab the m.channel_summary.to_dataframe(), then apply some queries to the df, reducing it to dataset_df and call a one liner.

@kkappler kkappler added the enhancement New feature or request label Jun 28, 2024
kkappler added a commit that referenced this issue Jul 2, 2024
- while working on issue #219, using the syntethic
examples for some snippets, the way survey was hokey
- now it is less hokey
kkappler added a commit that referenced this issue Jul 2, 2024
kkappler added a commit that referenced this issue Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant