Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add a client for Purdue Analysis Facility #219

Merged
merged 2 commits into from
Jul 4, 2024

Conversation

kondratyevd
Copy link
Contributor

@oshadura @alexander-held following up on our chat last month:

This PR adds an option to run CMS OpenData workflow at Purdue Analysis Facility via Dask Gateway cluster.
The setup is similar to the cmsaf-dev option, the only differences are:

  • The address of the Dask Gateway API server;
  • The default number of workers is 10 to avoid using too much resources when running AGC as a "smoke test".

Additional info about the Dask Gateway setup at Purdue AF can be found here. At Purdue AF, we have two Dask Gateway instances - with SLURM and Kubernetes backends. The purdue-af AGC client will use the Kubernetes backend.

Copy link
Member

@oshadura oshadura left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Member

@alexander-held alexander-held left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this!

@alexander-held alexander-held changed the title Add a client for Purdue Analysis Facility feat: add a client for Purdue Analysis Facility Jul 4, 2024
@alexander-held alexander-held merged commit d8b529f into iris-hep:main Jul 4, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants