2024
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing
EMNLP 2024finding
Sign language translation from video to spoken text presents unique challenges owing to the distinct grammar, expression nuances, and high variation of visual appearance across different speakers and contexts. Gloss annotations serve as an intermediary to guide the translation process. In our work,…