Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: make registry output to bazel-out #324

Merged
merged 8 commits into from
Jan 11, 2024
Merged

perf: make registry output to bazel-out #324

merged 8 commits into from
Jan 11, 2024

Conversation

thesayyn
Copy link
Collaborator

@thesayyn thesayyn commented Aug 4, 2023

This effectively eliminates the filesystem calls needed to copy the final image from the registry storage to the final output directory (bazel-out).

Partially addresses: #365

There's still room for performance improvement for oci_image targets with base, which is hard linking individual blobs from the base image to the output directory directly to eliminate fs copy calls for loading base image onto the registry as well. however, i am not sure how well that would work with Sandox and RBE. I'll leave that as a follow-up.

@thesayyn thesayyn requested a review from alexeagle August 4, 2023 22:39
oci/private/image.sh.tpl Outdated Show resolved Hide resolved
oci/private/image.sh.tpl Outdated Show resolved Hide resolved
oci/private/image.sh.tpl Outdated Show resolved Hide resolved
@thesayyn
Copy link
Collaborator Author

this is unblocked now; #424

@thesayyn thesayyn force-pushed the registry_perf branch 3 times, most recently from b856ded to e0ab631 Compare November 30, 2023 00:29
@thesayyn thesayyn marked this pull request as ready for review November 30, 2023 00:43
Copy link
Collaborator

@alexeagle alexeagle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have RBE testing for this repo? If not we'd better add it

e2e/custom_registry/registry/launcher.sh Outdated Show resolved Hide resolved
@thesayyn thesayyn merged commit db9273a into main Jan 11, 2024
20 checks passed
@thesayyn thesayyn deleted the registry_perf branch January 11, 2024 20:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants