Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve the instructions to add benchmark files manually #543

Merged
merged 8 commits into from
Oct 16, 2023

Conversation

sauraank
Copy link
Contributor

@sauraank sauraank commented Oct 6, 2023

Improved the instructions to add benchmark files manually in doc/BENCHMARKING.md.

Description of change

As write is enabled on mountpoint, easiest way to manually add benchmark files is using fio on mounted directory for the bucket. Also, added instruction for adding directories for readdir workload using fio.

Relevant issues:
NA

Does this change impact existing behavior?

No


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 03:06 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 03:06 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 03:06 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 03:06 — with GitHub Actions Inactive
@dannycjones dannycjones requested a review from monthonk October 6, 2023 09:24
@sauraank sauraank had a problem deploying to PR integration tests October 6, 2023 12:29 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests October 6, 2023 12:29 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests October 6, 2023 12:29 — with GitHub Actions Failure
@sauraank sauraank had a problem deploying to PR integration tests October 6, 2023 12:29 — with GitHub Actions Failure
Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:30 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:30 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:30 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:30 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:34 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:34 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:34 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 6, 2023 12:34 — with GitHub Actions Inactive
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank had a problem deploying to PR integration tests October 9, 2023 10:48 — with GitHub Actions Failure
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 10:48 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 10:48 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 10:48 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 12:53 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 12:53 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 12:53 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 12:53 — with GitHub Actions Inactive
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
doc/BENCHMARKING.md Outdated Show resolved Hide resolved
Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank had a problem deploying to PR integration tests October 9, 2023 17:25 — with GitHub Actions Failure
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 17:25 — with GitHub Actions Inactive
@sauraank sauraank had a problem deploying to PR integration tests October 9, 2023 17:25 — with GitHub Actions Failure
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 17:25 — with GitHub Actions Inactive
Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 17:29 — with GitHub Actions Inactive
@sauraank sauraank had a problem deploying to PR integration tests October 9, 2023 17:29 — with GitHub Actions Failure
@sauraank sauraank temporarily deployed to PR integration tests October 9, 2023 17:29 — with GitHub Actions Inactive
@sauraank sauraank had a problem deploying to PR integration tests October 9, 2023 17:29 — with GitHub Actions Failure
aws s3 cp your_local_dir/your_file_name s3://${S3_BUCKET_NAME}/${S3_BUCKET_TEST_PREFIX}
3. Create the bench files manually in your S3 bucket. You can do that by mounting the bucket on your machine using Mountpoint. Then, running fio jobs against your mount directory to let fio create the files for you.

MOUNT_DIR = path/to/mount
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: remove the space.

Suggested change
MOUNT_DIR = path/to/mount
MOUNT_DIR=path/to/mount

Signed-off-by: Ankit Saurabh <[email protected]>
@sauraank sauraank temporarily deployed to PR integration tests October 10, 2023 09:52 — with GitHub Actions Inactive
@sauraank sauraank had a problem deploying to PR integration tests October 10, 2023 09:52 — with GitHub Actions Failure
@sauraank sauraank temporarily deployed to PR integration tests October 10, 2023 09:52 — with GitHub Actions Inactive
@sauraank sauraank had a problem deploying to PR integration tests October 10, 2023 09:52 — with GitHub Actions Failure
Copy link
Contributor

@monthonk monthonk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@sauraank sauraank temporarily deployed to PR integration tests October 16, 2023 18:54 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 16, 2023 18:54 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 16, 2023 18:54 — with GitHub Actions Inactive
@sauraank sauraank temporarily deployed to PR integration tests October 16, 2023 18:54 — with GitHub Actions Inactive
@sauraank sauraank added this pull request to the merge queue Oct 16, 2023
Merged via the queue into awslabs:main with commit 9db1d24 Oct 16, 2023
@sauraank sauraank deleted the benchmark_docs branch October 16, 2023 21:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants