Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/ncei extraction #2

Merged
merged 7 commits into from
May 14, 2024
Merged

Feature/ncei extraction #2

merged 7 commits into from
May 14, 2024

Conversation

collijk
Copy link
Member

@collijk collijk commented May 13, 2024

This PR adds in a script to extract the NCEI climate station data. Because it's the first script it also sets up several infrastructure pieces:

  • This PR adds two entry points (ie command line tools that get installed when you install this package):
    • cdtask: This entry point will be used to run individual workflow tasks. This is super useful for debugging
    • cdrun: This entry point will launch parallel jobs using jobmon. Jobmon will invoke cdtask with appropriate arguments.
  • It adds an automatic discovery loop in the climate_downscale.cli so new commands are added automatically as long as they're appropriately imported. RUNNERS (ie cdrun subcommands) and TASK_RUNNERS (ie cdtask subcommands) are set up in climate_downscale.extract.
  • It adds a ClimateDownscaleData object that will parse the local directory structure and eventually load and save data. This will make it super easy to move around the data/modeling root.
  • Starts a README for climate data extractions

In addition, the actual extraction script is included.

@collijk collijk requested a review from nhashmeh May 13, 2024 17:58
Base automatically changed from feature/add-dependencies to main May 13, 2024 22:14
@collijk collijk merged commit b3afa81 into main May 14, 2024
6 of 7 checks passed
@collijk collijk deleted the feature/ncei-extraction branch May 14, 2024 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants