Title
Neural Sign Language Translation by Learning Tokenization
Abstract
Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign videos if supervised data is available. However, data annotation at the gloss level is costly, and annotated data is scarce. The paper utilizes Adversarial, Multitask, Transfer Learning to search for semi-supervised tokenization approaches without burden of additional labeling. It provides extensive experiments to compare all the methods in different settings to conduct a deeper analysis. In the case of no additional target annotation besides sentences, the proposed methodology attains 13.25 BLUE-4 and 36.28 ROUGE scores which improves the current state-of-the-art by 4 points in BLUE-4 and 5 points in ROUGE.
Year
DOI
Venue
2020
10.1109/FG47880.2020.00002
2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
Keywords
DocType
ISSN
Computer Vision,NLP,Linguistics,Multitask Learning,Domain Adaptation
Conference
2326-5396
ISBN
Citations 
PageRank 
978-1-7281-3080-4
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Orbay Alptekin100.34
lale akarun2120170.68