Title
Towards a visual Sign Language dataset for home care services
Abstract
We present our work towards creating a dataset, which is intended to be used for the implementation of a home care services system for the deaf. The dataset includes recorded realistic scenarios of interactions between deaf patients and mental health experts in their native sign language. The scenarios allow for contextualized representations, in contrast to typical datasets presenting isolated signs or sentences. It includes continuous videos in RGB and depth, which are challenging to analyze and closely resemble real-life scenarios. The research on representation of signs is supported by providing the hand shapes and trajectories for every video using hand and skeleton models, as well as facial features. Furthermore, the dataset may be used for studying the emotional context, since such conversations are typically emotionally charged.
Year
DOI
Venue
2020
10.1109/FG47880.2020.00099
2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
Keywords
DocType
ISSN
visual sign language dataset,home care services system,deaf patients,mental health experts,native sign language,contextualized representations,continuous videos,RGB,sign representation,hand shapes,hand trajectories,hand model,skeleton model,emotional context
Conference
2326-5396
ISBN
Citations 
PageRank 
978-1-7281-3080-4
0
0.34
References 
Authors
9
9