Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add workflows helper functions for sparse data #1397

Closed
EmilHvitfeldt opened this issue Nov 18, 2024 · 2 comments · Fixed by #1410
Closed

Add workflows helper functions for sparse data #1397

EmilHvitfeldt opened this issue Nov 18, 2024 · 2 comments · Fixed by #1410
Labels
feature a feature request or enhancement

Comments

@EmilHvitfeldt
Copy link
Member

What we need is a set of functions that that can help determine whether a recipe with sparse supporting steps should handle them as sparse or dense.

First we need a function that can toggle sparse argument. for a given step, the function should set all sparse arguments that are set to "auto" and respects if they are already set to "yes" or "no".

secondly, and harder, is a function that estimates the amount of sparsity that is produces from a recipe. For now it will be fairly simple since we don't have input-output information. It should further rely on early exits for maximal performance. e.i. if the recipe doesn't contain sparse steps -> early return.

@EmilHvitfeldt
Copy link
Member Author

closed in #1397

Copy link

This issue has been automatically locked. If you believe you have found a related problem, please file a new issue (with a reprex https://reprex.tidyverse.org) and link to this issue.

@github-actions github-actions bot locked and limited conversation to collaborators Jan 30, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature a feature request or enhancement
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant