Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nrt_utils support defaultCredentialsProvider #614

Merged
merged 2 commits into from
Mar 20, 2024

Conversation

waziqi89
Copy link
Contributor

@waziqi89 waziqi89 commented Dec 27, 2023

RP-9895

Support default credential providers for nrt_utils.
This allows us to use instance profile for AmazonS3.

manual test from dev: https://fluffy.yelpcorp.com/i/mfBgzt5W6T7s6KTNV1n38SpSDRg0gkcm.html

edge case:
When a user want to use default cred-file-path with a non-default profile name:

  1. manually put -c ~/.aws/credentials -p profile-name
  2. provide profile name as an env: AWS_PROFILE=profile-name

@waziqi89 waziqi89 requested a review from aprudhomme January 5, 2024 16:41
@waziqi89
Copy link
Contributor Author

waziqi89 commented Jan 5, 2024

Hi @aprudhomme! Just to confirm: how do we apply the change the the tron jobs?
merge this PR, and create a new base image? And then the tron job will automatically pick up the latest utils?

@@ -69,12 +69,13 @@ public class DeleteIncrementalSnapshotsCommand implements Callable<Integer> {

@CommandLine.Option(
names = {"-c", "--credsFile"},
description = "File holding AWS credentials, uses default locations if not set")
description =
"File holding AWS credentials, uses default locations if not set; Will use DefaultCredentialProvider if this is unset.")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the description contain only uses default credential provider chain if this is unset instead of also including uses default locations if not set?

@waziqi89 waziqi89 merged commit d1153bb into Yelp:master Mar 20, 2024
1 check passed
@waziqi89 waziqi89 deleted the u/waziqi/RP-9895-nrt-utils-migration branch December 13, 2024 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants