Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmarking? #233

Open
adrn opened this issue Oct 18, 2024 · 2 comments
Open

Add benchmarking? #233

adrn opened this issue Oct 18, 2024 · 2 comments

Comments

@adrn
Copy link
Contributor

adrn commented Oct 18, 2024

It might be good to have benchmarking comparisons for all unxt primitives and overrides against pure-numpy and pure-JAX to check for unexpected overheads in jitted and graded functions that contain units. But after doing some search, it seems like there are no well maintained benchmarking packages for modern Python!

@nstarman
Copy link
Contributor

I know people use CodSpeed, which has the same API as pytest-benchmark. It looks really good. I've just had some trouble getting it to work with a Jax library on GH's VMs. When I run it locally it works.

@nstarman
Copy link
Contributor

nstarman commented Oct 31, 2024

See #265. It's partially working. It's not reporting deltas, but it is measuring performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants