Adaptive Simultaneous Sign Language Translation with Confident Translation Length Estimation

Source code for our LREC-COLING2024 paper "Adaptive Simultaneous Sign Language Translation with Confident Translation Length Estimation".

We also provide SimulEval-SLT, a general evaluation framework for simultaneous translation on sign languages.

Requirements and Installation

Install fairseq and develop locally

git clone https://github.com/tongsun99/CTL
cd CTL
pip install -e .

Install SimulEval-SLT and develop locally

git clone https://github.com/tongsun99/SimulEval-SLT
cd SimulEval-SLT
pip install -e .

Usage

Detailed introductions refer to:

• Wait-k
• MU-ST
• CTL(++)

Acknowledgements

Our code is inspired by the following repositories. Many thanks to their work!

• SimulEval

• Fairseq

• slue-toolkit

Citation

@inproceedings{sun2024adaptive,
  title={Adaptive Simultaneous Sign Language Translation with Confident Translation Length Estimation},
  author={Sun, Tong and Fu, Biao and Hu, Cong and Zhang, Liang and Zhang, Ruiquan and Shi, Xiaodong and Su, Jinsong and Chen, Yidong},
  booktitle={Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)},
  pages={372--384},
  year={2024}
}