Paper Info
Title
Vision-Based Finger Tapping Test in Patients With Parkinson’s Disease via Spatial-Temporal 3D Hand Pose Estimation
Abstract
Finger tapping test is crucial for diagnosing Parkinson’s Disease (PD), but manual visual evaluations can result in score discrepancy due to clinicians’ subjectivity. Moreover, applying wearable sensors requires making physical contact and may hinder PD patient’s raw movement patterns. Accordingly, a novel computer-vision approach is proposed using depth camera and spatial-temporal 3D hand pose estimation to capture and evaluate PD patients’ 3D hand movement. Within this approach, a temporal encoding module is leveraged to extend A2J’s deep learning framework to counter the pose jittering problem, and a pose refinement process is utilized to alleviate dependency on massive data. Additionally, the first vision-based 3D PD hand dataset of 112 hand samples from 48 PD patients and 11 control subjects is constructed, fully annotated by qualified physicians under clinical settings. Testing on this real-world data, this new model achieves 81.2% classification accuracy, even surpassing that of individual clinicians in comparison, fully demonstrating this proposition’s effectiveness. The demo video can be accessed at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/ZhilinGuo/ST-A2J</uri> .
Year
DOI
Venue
2022
10.1109/JBHI.2022.3162386
IEEE Journal of Biomedical and Health Informatics
Keywords
DocType
Volume
Hand,Humans,Movement,Parkinson Disease
Journal
26
Issue
ISSN
Citations 
8
2168-2194
0
PageRank 
References 
Authors
0.34
18
7
Name
Order
Citations
PageRank
Zhilin Guo100.34
Weiqi Zeng200.34
Taidong Yu300.34
Yan Xu400.34
Yang Xiao523726.58
Xuebing Cao600.34
Zhiguo Cao731444.17