Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

a small bug about RSTPReid dataset #31

Open
shujielan opened this issue Nov 16, 2023 · 3 comments
Open

a small bug about RSTPReid dataset #31

shujielan opened this issue Nov 16, 2023 · 3 comments

Comments

@shujielan
Copy link

谢谢你写出这么优秀的文章。我对你的文章比较感兴趣。作为初学者,我在复现代码的时候采用这个数据集,发现mlm设置是false,修改为true之后出现了新的问题,当执行到bulid文件的if 'mlm' in self.current_task时,计算输入x的qkv时候维度出现了问题。q维度是(128,77,512),k和v维度是(128,193,512),我个人理解是觉得transformer内部会对k进行转置再和q进行计算,但是出现了shape '[-1,616,64]' is invalid for input of size 12648448,请问在复现这个数据集的时候出现这个问题是需要自己修改维度嘛?感觉计算的时候都是进入内置函数计算的,如果需要修改的话要提前在进入cross_former之前对qkv维度进行修改吗?

@shujielan
Copy link
Author

是否可以直接在进入cross_former之前对image_feats进行linear转换呢?这个操作对正确率影响精度大吗

@fzb408
Copy link

fzb408 commented Nov 17, 2023

This is a problem with your torch version. Use version 11.3 or above.

@shujielan
Copy link
Author

This is a problem with your torch version. Use version 11.3 or above.

thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants