Title
Detection of Osteoarthritis from Multimodal Hand Data.
Abstract
Osteoarthritis (OA) describes a degenerative joint disorder that is prevalent among older people and typically results in swollen and inflamed joints. The aim of this paper is to develop a method using images, videos and thermal data of 100 patients taken at Keio University Hospital to detect OA in hands. By using hand pose estimation on the video data, joint angles can be calculated and subsequently transformed into feature vectors. For the thermal and RGB images, hand keypoint detectors were trained to identify and crop the appropriate joints within the images. The resulting extracted features are combined and further trained on Support Vector Machines and Convolutional Neural Networks to obtain the final binary classification for each joint. While the proposed method generally shows favorable accuracy and F1-scores on the Proximal (PIP) and Distal Interphalangeal (DIP) joints, the performance on the Metacarpophalangeal (MCP) joints is limited by the low occurrence of affected joints in the dataset. We further compare the different modalities and found that, apart from the combined approach, using video data provides the best results. Clinical Relevance- The proposed method shows promising first results for the usage of visual and thermal data in combination with machine learning in order to detect OA.
Year
DOI
Venue
2022
10.1109/EMBC48229.2022.9871560
Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
DocType
Volume
ISSN
Conference
2022
2694-0604
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Julian Jorge Andrade Guerreiro100.34
Yoshimitsu Aoki28023.65
Shuntaro Saito300.34
Katsuya Suzuki4275.37