Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GHA testing] Add S3 express benchmark #767

Merged

Conversation

sauraank
Copy link
Contributor

@sauraank sauraank commented Feb 21, 2024

Description of change

I am adding S3 express benchmark for our Github CI. I want to test it first how much time it takes and then proceed further.

I have added another workflow for bench_s3_express.yml which takes s3 express one zone bucket instead of standard bucket. I have also made small change in our benchmark scripts to add the step of creation of objects for benchmark in the script itself.

NOTE-- Additional change in this PR is changing the fio job of creating files due to which previous benchmarks were getting TOKEN_EXPIRED error: https://github.com/awslabs/mountpoint-s3/actions/runs/7988542843/job/21813343599

Relevant issues:

Does this change impact existing behavior?

No, it only adds benchmark for s3 express.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 14:58 — with GitHub Actions Failure
@sauraank sauraank force-pushed the s3-express_benchmark branch from aadd4ce to b8e70df Compare February 21, 2024 15:07
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:07 — with GitHub Actions Failure
Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank force-pushed the s3-express_benchmark branch from b8e70df to 01da2ba Compare February 21, 2024 15:11
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:11 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:11 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:12 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:12 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:12 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:12 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:12 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:15 — with GitHub Actions Failure
@sauraank sauraank force-pushed the s3-express_benchmark branch from 9bf7740 to 417ab9a Compare February 21, 2024 15:16
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests February 21, 2024 15:16 — with GitHub Actions Failure
@sauraank sauraank changed the base branch from main to wf-changes/s3-express-benchmark February 21, 2024 15:17
@sauraank sauraank marked this pull request as ready for review February 21, 2024 15:17
@sauraank sauraank merged commit 7449756 into awslabs:wf-changes/s3-express-benchmark Feb 21, 2024
17 of 24 checks passed
@dannycjones dannycjones changed the title Add S3 express benchmark [GHA testing] Add S3 express benchmark Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant