Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to fix inter-volume trace pair functions #243

Closed

Conversation

majosm
Copy link
Collaborator

@majosm majosm commented Mar 25, 2022

I abandoned the previous one-way communication idea (I didn't know how to make this work in lazy, since there wouldn't be anything to staple the sends to). This PR is an attempt to implement a two-way version. Still untested.

Since the trace data is possibly heterogeneous in the multi-volume case, the sends in _RankBoundaryCommunicationLazy can't be stapled to the receives anymore (since the sent and received data on a given rank will in general have different numbers of subarrays). As a workaround, I staple the sends to arrays of zeros with the same shape as the data being sent. Then I reduce the resulting array container of zeros to a scalar zero value, and add it to the trace pair data being returned so that something (hopefully) will depend on it.

Depends on #239 (and inducer/meshmode#308).

@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 8c86c98 to 012341d Compare March 25, 2022 18:52
return 0
else:
ary_tag = (comm_tag, key)
return staple_distributed_send(
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make the send separately from stapling it.

@majosm majosm mentioned this pull request Apr 4, 2022
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 81b7b7e to 4c7292e Compare April 12, 2022 14:42
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 97915bd to 0603005 Compare May 2, 2022 18:23
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 0603005 to 730e0b4 Compare May 2, 2022 18:34
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch 2 times, most recently from 16fe9e8 to f25fe19 Compare May 4, 2022 20:40
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from f25fe19 to 92d0a36 Compare May 23, 2022 15:41
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 92d0a36 to fb2cac5 Compare June 21, 2022 19:38
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from fb2cac5 to 0f94e3d Compare July 1, 2022 18:23
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch 2 times, most recently from 6ae2cca to 1c76f6e Compare July 4, 2022 15:15
@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from 1c76f6e to fd644cf Compare July 4, 2022 18:27
@majosm
Copy link
Collaborator Author

majosm commented Jul 4, 2022

@inducer This is probably ready for a look too (though it still contains all of #239; I'll leave it as a draft until that gets merged.)

@majosm majosm force-pushed the cross-rank-inter-volume-trace-pairs branch from fd644cf to 12a6443 Compare August 9, 2022 21:14
@majosm majosm mentioned this pull request Sep 23, 2022
2 tasks
@majosm
Copy link
Collaborator Author

majosm commented Sep 26, 2022

Superseded by #280 and #285.

@majosm majosm closed this Sep 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants