Paper Info
Title
VRheab: a fully immersive motor rehabilitation system based on recurrent neural network.
Abstract
In this paper, a fully immersive serious game system that combines two Natural User Interfaces (NUIs) and a Head Mounted Display (HMD) to provide an interactive Virtual Environment (VE) for patient rehabilitation is proposed. Patients’ data are acquired in real-time by the NUIs, while by the HMD the VE is shown to them, thus allowing the interaction. A Long Short-Term Memory Recurrent Neural Network (LSTM-RNN), previously trained by healthy subjects (i.e., baseline), processes patients’ movements in real-time during the rehabilitation exercises to provide the degree of their performance. By comparing the functionalities of the proposed system with the ongoing state-of-the-art, it is worth noting that the reported fully immersive serious game system provides a concrete contribute to the current literature in terms of completeness and versatility. The results obtained by three rehabilitation exercises, chosen as reference case studies, performed on real patients affected by Parkinson’s disease have shown the effectiveness of the presented approach. Finally, the analysis of the feedbacks received by the therapists and patients who have used the system have highlighted remarkable results in terms of motivation, acceptance, and usability.
Year
DOI
Venue
2018
10.1007/s11042-018-5730-1
Multimedia Tools Appl.
Keywords
Field
DocType
Rehabilitation, Virtual reality, Human-computer interaction, Sensors data fusion, Deep learning
Rehabilitation,Computer vision,Virtual reality,Virtual machine,Computer science,Usability,Recurrent neural network,Human–computer interaction,Optical head-mounted display,Artificial intelligence,Deep learning,User interface
Journal
Volume
Issue
ISSN
77
19
1380-7501
Citations 
PageRank 
References 
4
0.43
28
Authors
5
Name
Order
Citations
PageRank
Danilo Avola113425.14
Luigi Cinque239841.17
Gian Luca Foresti3447.06
Marco Raoul Marini451.79
Daniele Pannone584.57