Paper Info
Title
Personalized gestural interaction applied in a gesture interactive game-based approach for people with disabilities
Abstract
ABSTRACTTechnology can support people with disabilities to participate in social and economic life. Using relevant Human-Computer Interaction, as obtained through Intelligent User Interfaces, people with motor and speech impairments may be able to communicate in different ways. Augmentative and Alternative Communication supported by Computer Vision systems can benefit from the recognition of users' remaining functional motions as an alternative interaction design approach. Based on a methodology in which gestures and their meanings are created and configured by users and their caregivers, we developed a Computer Vision system, named PGCA, that employs machine learning techniques to create personalized gestural interaction as an Assistive Technology resource for communication purposes. Using a low-cost approach, PGCA has been experienced with students with motor and speech impairments to create personalized gesture datasets and to identify improvements for the system. This paper presents an experiment carried with the target audience using a game-based approach where three students used PGCA to interact with communication boards and to play a game. The system was evaluated by special education professionals using the System Usability Scale and was considered suitable for its purpose. Results from the experiment suggest the technical feasibility for the methodology and for the system, also adding knowledge about the interaction process of disabled people with a game.
Year
DOI
Venue
2020
10.1145/3377325.3377495
Intelligent User Interfaces
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Rúbia E. O. Schultz Ascari100.34
Luciano Silva29313.58
Roberto Pereira33512.67