Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

10k frame memory? #89

Open
dcompgriff opened this issue Jan 22, 2025 · 1 comment
Open

10k frame memory? #89

dcompgriff opened this issue Jan 22, 2025 · 1 comment

Comments

@dcompgriff
Copy link

How can I configure the model to use a video with 10k frames, sampled at 1 frame per second? I'd like to have a model that can answer questions across video data aggregated across a 2 hour video at 1 fps.

@Espere-1119-Song
Copy link
Collaborator

Setting short-term memory length to 34, and long-term memory length to 512 can achieve 8k frames. The total frame number = (short-term memory length - 2 ) * (long-term memory length / 2). Please note that it will take a pretty long time to process these frames (maybe over 1h).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants