Paper Info
Title
Video-based social behavior recognition based on kernel relevance analysis
Abstract
This paper presents a kernel-based relevance analysis for video data to support social behavior recognition. Our approach, termed KRAV, is twofold: (i) A feature ranking based on centered kernel alignment (CKA) is carried out to match social semantic features with the output labels (individual and group behaviors). The employed method is an extension of the conventional CKA to mitigate the imbalance effect of unusual human behaviors. (ii) A classification stage to perform the behavior prediction. For concrete testing, the Israel Institute of Technology social behavior database is employed to assess the KRAV under a tenfold cross-validation scheme. Attained results show that the proposed approach for the individual recognition task obtains 0.5925 $$F_1$$ measure using 50 relevant features. Likewise, for the group recognition task obtains 0.8094 $$F_1$$ measure using 12 relevant features, which in both cases outperforms state-of-the-art results concerning the classification performance and number of employed features. Also, our video-based approach would assist further social behavior analysis from the set of features selected regarding the recognition of individual profiles and group behaviors.
Year
DOI
Venue
2020
10.1007/s00371-019-01754-y
The Visual Computer
Keywords
DocType
Volume
Social behavior recognition, Relevance analysis, Kernel methods, Video surveillance
Journal
36
Issue
ISSN
Citations 
8
0178-2789
1
PageRank 
References 
Authors
0.40
0
5
Name
Order
Citations
PageRank
J. Fernández-Ramírez110.40
Andrés Álvarez-Meza2252.46
E. M. Pereira310.40
A. Orozco-Gutiérrez410.40
G. Castellanos-Dominguez522.09