Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What version of CodeGemma 7B is being used? #11

Open
ggcr opened this issue Jan 27, 2025 · 0 comments
Open

What version of CodeGemma 7B is being used? #11

ggcr opened this issue Jan 27, 2025 · 0 comments

Comments

@ggcr
Copy link

ggcr commented Jan 27, 2025

I was wondering whether which version of CodeGemma 7B is used in the papers. In HuggingFace there are two versions, the Base model and the Instruct model. In NIM there is only one version of CodeGemma 7B but it is not specified if it is the base or the instruct model.

I ask this because I am having a hard time replicating the results locally using HF models with the base model alone, the instruct model seems more aligned with your paper (7% vs 12% on Code Completition and 9% vs 11 on Spec to RTL).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant