Paper Info
Title
Development And Validation Of A Brazilian Sign Language Database For Human Gesture Recognition
Abstract
Sign language recognition is considered the most important and challenging application in gesture recognition, involving the fields of pattern recognition, machine learning and computer vision. This is mainly due to the complex visual-gestural nature of sign languages and the availability of few databases and studies related to automatic recognition. This work presents the development and validation of a Brazilian sign language (Libras) public database. The recording protocol describes (1) the chosen signs, (2) the signaller characteristics, (3) the sensors and software used for video acquisition, (4) the recording scenario and (5) the data structure. Provided that these steps are well defined, a database with more than 1000 videos of 20 Libras signs recorded by twelve different people is created using an RGB-D sensor and an RGB camera. Each sign was recorded five times by each signaller. This corresponds to a database with 1200 samples of the following data: (1) RGB video frames, (2) depth, (3) body points and (4) face information. Some approaches using deep learning-based models were applied to classify these signs based on 3D and 2D convolutional neural networks. The best result shows an average accuracy of 93.3%. This paper presents an important contribution for the research community by providing a publicly available sign language dataset and baseline results for comparison.
Year
DOI
Venue
2021
10.1007/s00521-021-05802-4
NEURAL COMPUTING & APPLICATIONS
Keywords
DocType
Volume
Brazilian sign language, Database, MINDS-Libras, Sign language recognition, Deep learning, CNN
Journal
33
Issue
ISSN
Citations 
16
0941-0643
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Tamires Martins Rezende100.34
Sílvia Grasiella Moreira Almeida200.34
Frederico Gadelha Guimarães3859.20