Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inference test enhance #710

Closed
wants to merge 2 commits into from

Conversation

sakogan
Copy link

@sakogan sakogan commented Aug 30, 2023

Allow specifying the number of quantization groups in the inference test script using a quantize_groups argument.

This PR is complimentary to PR #3519 on the main repo, and should be merged with (or after) merging PR #3519.

Tagging @RezaYazdaniAminabadi as a reviewer on PR #3519.

@sakogan
Copy link
Author

sakogan commented Aug 30, 2023

need to rewrite according to recent code changes in this repo, will reopen shortly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant