Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Symmetric vs Random Initialization for some benchmarks #28

Open
hardik01shah opened this issue Dec 14, 2024 · 1 comment
Open

Symmetric vs Random Initialization for some benchmarks #28

hardik01shah opened this issue Dec 14, 2024 · 1 comment

Comments

@hardik01shah
Copy link
Contributor

For some benchmarks like correlation and covariance, the initialization of the matrix is a symmetric matrix. This unfortunately validates incorrect implementations for the benchmarks. Is there any specific reason for initializing the matrices as symmetric in the way they currently are?
On experimenting with random initialization, I found that they were less susceptible to validating wrong implementations for the benchmarks.

Happy to put in a PR addressing this.

@alexnick83
Copy link
Contributor

Benchmarks that do not have random initialization follow instead the data generation of the original codes. For example, correlation and covariance are taken from Polybench. All Polybench benchmarks use the same initialization as the C version, with the only exception being GramSchmidt (transposes the matrix).

The main reason not to use random data is that the problem is defined only if the input satisfies certain properties. For example, inverting a singular (or almost singular) matrix. Therefore, I would check if the codes actually work properly with random data or if they produce "garbage."

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants