Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

attention head weight shapes in paddle and pytorch model are different #41

Open
iazdan opened this issue Jun 16, 2022 · 1 comment
Open

Comments

@iazdan
Copy link

iazdan commented Jun 16, 2022

I was able to convert the PP-structure paddle train model (best_accuracy.pdparams, best_accuracy.pdopt, best_accuracy.stated) to pytorch model (model.pth). However I realized that the model output is not the same as the paddle model. I did some investigation and I seems the paddle and the backbone weights are the same however the shape of the attention head in the pytorch model is different than the paddle model. This is a bug in the code. Would you be able to fix it?

Thanks

@frotms
Copy link
Owner

frotms commented Jun 18, 2022

table model is not supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants