Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allows you to benchmark against 1 chosen URL. #742

Merged
merged 3 commits into from
Oct 6, 2024
Merged

Conversation

lemire
Copy link
Member

@lemire lemire commented Sep 27, 2024

This modifies slightly one of our benchmark program so that we can narrowly benchmark URLs one by one if needed.

@lemire lemire requested a review from anonrig September 27, 2024 22:26
@anonrig
Copy link
Member

anonrig commented Sep 28, 2024

aarch64 is once again failing with a constexpr issue...

@@ -7,7 +7,11 @@ double url_examples_bytes{};

std::vector<std::pair<std::string, std::string>> url_examples;

size_t init_data(const char *source) {
enum {
ALL_URLS = -1,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add a documentation on how to run the benchmarks?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@anonrig I pushed another commit which I expect might fix this build issue.

@lemire
Copy link
Member Author

lemire commented Sep 28, 2024

@anonrig Regarding documentation, have you seen this?

Screenshot 2024-09-28 at 3 53 17 PM

Note that though it is not well documented, we can also filter benchmarks..

./build/benchmarks/wpt_bench   tests/wpt/urltestdata.json --benchmark_filter=BasicBench_AdaURL_url_aggregator

But that's Google Benchmark stuff. (And it was not previously documented.)

Note that the command line processing is not great in these tools. It is kind of a hack, but we don't expect most users to care about these details.

@lemire
Copy link
Member Author

lemire commented Sep 28, 2024

I see it is still failing the aarch64 ... :-/

@anonrig
Copy link
Member

anonrig commented Oct 6, 2024

@lemire it seems aarch64 is still failing. would you mind taking a look into it?

@anonrig anonrig merged commit 3beec34 into main Oct 6, 2024
27 of 28 checks passed
@anonrig anonrig deleted the allow_one_url branch October 6, 2024 00:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants