Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about LLaVA-Video-32B-Qwen: Performance issues #401

Open
Rachel0901 opened this issue Jan 28, 2025 · 1 comment
Open

Question about LLaVA-Video-32B-Qwen: Performance issues #401

Rachel0901 opened this issue Jan 28, 2025 · 1 comment

Comments

@Rachel0901
Copy link

I have a few questions regarding the 32B video model implementations and performance:

  1. Could you clarify which is the latest model: lmms-lab/LLaVA-NeXT-Video-32B-Qwen or lmms-lab/LLaVA-Video-32B-Qwen? It’s unclear which one should be used for the latest evaluations.

  2. In practical implementations, I’ve noticed that the 32B model appears to perform worse than the 7B and 72B models. Any idea why this might be the case?

  3. I also observed that there hasn’t been a performance evaluation of the 32B model on the latest evaluation benchmarks. Is this due to any particular issue with the model, or has it simply not been prioritized for testing?
@ZhangYuanhan-AI
Copy link
Collaborator

1.The data used for 32B model is different from 7B and 72B.
2. 32B is just an early version for demo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ZhangYuanhan-AI @Rachel0901