Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

好奇为什么multimodal method和整体method设为一样的 #2

Open
yuxinokk opened this issue Jan 18, 2025 · 1 comment
Open

好奇为什么multimodal method和整体method设为一样的 #2

yuxinokk opened this issue Jan 18, 2025 · 1 comment

Comments

@yuxinokk
Copy link

觉得可能是这里导致了nan,因为multimodal method的缩写map映射中没有提到mintood,不太理解为什么要把multimodal method和整体method设为一样的

@zhougr18
Copy link
Collaborator

您好!由于mintood方法在特征表示学习部分需要先后进行二分类和多分类两种训练,为了实现方便,我们把mintood模型拆分成了MMEncoder和MLP_head两个部分,这与一般的multimodal method不同,因此没有使用map映射的方式索引mintood,但是这并不影响代码正常运行。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants