Awesome Long Video Understanding:

A curated list of real long-form video understanding resources, inspired by awesome-computer-vision.

Contents

• Dataset
  • Long-form video dataset
  • SOTA Result
• Survey
• Papers & Codes
• Miscellaneous

Dataset

Video-Text Dataset

• VIOLIN
• ShareGPT4Video
• Panda-70
• M-SYMON

Long-form video dataset

• MovieChat
• VidChapter
• MovieNet
• EgoSchema
• NeXT-QA

Video Editing Dataset

• TGT
• AVE
• MovieCuts
• MatchCutting
• Edit3K
• EditVid-QA
• AutoTransition
• AudioMatchCutting

Movie-related video dataset

• MovieQA
• TVSum
• SFD
• MovieGraph
• MAD
• Trailer
• Learn to Cuts
• Movie Description Dataset

Video Understanding Evaluation Benchmark

• VBench
• MVBench
• Vript
• ViP-Bench
• VideoVista
• Video-MME
• Video-Bench
• Event-Bench
• TempCompass
• Needle In A Video Haystack
• MMBench-Video
• MLVU
• LVBench

SOTA Result

🔨TODO: Collect SOTA results of different datasets and merge to one table

Related Survey

• Video Understanding with Large Language Models: A Survey

Papers & Codes

🔨TODO: Categorize the papers and works.

Miscellaneous

• video2dataset: video dataset construction and download tools.

Contributing

Please read the contribution guidelines. Then please feel free to send me pull requests or email ([email protected]) to add links.