Title
WHITE STAG model: wise human interaction tracking and estimation (WHITE) using spatio-temporal and angular-geometric (STAG) descriptors
Abstract
To understand human to human dealing accurately, human interaction recognition (HIR) systems require robust feature extraction and selection methods based on vision sensors. In this paper, we have proposed WHITE STAG model to wisely track human interactions using space time methods as well as shape based angular-geometric sequential approaches over full-body silhouettes and skeleton joints, respectively. After feature extraction, feature space is reduced by employing codebook generation and linear discriminant analysis (LDA). Finally, kernel sliding perceptron is used to recognize multiple classes of human interactions. The proposed WHITE STAG model is validated using two publicly available RGB datasets and one self-annotated intensity interactive dataset as novelty. For evaluation, four experiments are performed using leave-one-out and cross validation testing schemes. Our WHITE STAG model and kernel sliding perceptron outperformed the existing well known statistical state-of-the-art methods by achieving a weighted average recognition rate of 87.48% over UT-Interaction, 87.5% over BIT-Interaction and 85.7% over proposed IM-IntensityInteractive7 datasets. The proposed system should be applicable to various multimedia contents and security applications such as surveillance systems, video based learning, medical futurists, service cobots, and interactive gaming.
Year
DOI
Venue
2020
10.1007/s11042-019-08527-8
Multimedia Tools and Applications
Keywords
DocType
Volume
Full body silhouettes, Human interaction recognition, Kernel sliding perceptron, Spatio-temporal angular-geometric features, Skeleton joints
Journal
79
Issue
ISSN
Citations 
11
1380-7501
1
PageRank 
References 
Authors
0.36
0
3
Name
Order
Citations
PageRank
Maria Mahmood110.36
Ahmad Jalal215311.00
Kibum Kim313618.81