Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check manifests/restart.yaml md5 hashes in repro test #86

Open
aekiss opened this issue Nov 12, 2024 · 3 comments
Open

Check manifests/restart.yaml md5 hashes in repro test #86

aekiss opened this issue Nov 12, 2024 · 3 comments
Assignees

Comments

@aekiss
Copy link
Contributor

aekiss commented Nov 12, 2024

payu generates manifests/restart.yaml files containing md5 hashes of all restart files.

Checking these would be a quick, easy and thorough way to confirm bitwise reproducibility of all model components, e.g. for ACCESS-OM3.

@aekiss
Copy link
Contributor Author

aekiss commented Nov 12, 2024

manifests/restart.yaml records the input restarts for the run, so this test would require two consecutive runs and checking the second one, ie archive/output001/manifests/restart.yaml.

@access-hive-bot
Copy link

This issue has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/ocean-team-workshop-12-15th-november-2024/3857/7

@anton-seaice
Copy link

We weren't convinced about the completeness of comparing ocean.stats for reproducibility - it seemed like rounding errors differences may not get caught. As the restart.yml has checksums for the restart files, this is a more complete check.

As Andrew noted - the checksums are calculated during payu setup, so payu setup would need to be run after the model run to calculate the new checksums.

@github-project-automation github-project-automation bot moved this to New Issues 🌅 in Model Release Nov 21, 2024
@CodeGat CodeGat self-assigned this Nov 21, 2024
@CodeGat CodeGat moved this from New Issues 🌅 to Todo ⏳ in Model Release Nov 21, 2024
@chrisb13 chrisb13 moved this to Todo in ACCESS-OM3 025 Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Status: Todo ⏳
Development

No branches or pull requests

4 participants