Title
Hybrid Multi-Modal Fusion For Human Action Recognition
Abstract
We introduce in this paper a hybrid fusion approach allowing the efficient combination of the Kinect modalities within the feature, representation and decision levels. Our contributions are three-fold: (i) We propose an efficient concatenation of complementary per-modality descriptors that rely on the joint modality as a high-level information. (ii) We apply a multi-resolution analysis that combines the local frame wise decisions with the global BoVW ones. We rely in this context on the scalability of the Fisher vector representation in order to handle large-scale data and apply additional concatenation of its output. (iii) We also propose an efficient score merging scheme by generating multiple weighting-coefficients that combine the strength of different SVM classifiers with a given action label. By evaluating our approach on the Cornell activity dataset, state-of-the-art performances are obtained.
Year
DOI
Venue
2017
10.1007/978-3-319-59876-5_23
IMAGE ANALYSIS AND RECOGNITION, ICIAR 2017
Keywords
Field
DocType
Human action recognition, Hybrid fusion, Fisher vectors, Kinect modalities, Cornell activity dataset
Modalities,Pattern recognition,Fisher vector,Computer science,Support vector machine,Fusion,Artificial intelligence,Concatenation,Score,Modal,Scalability
Conference
Volume
ISSN
Citations 
10317
0302-9743
0
PageRank 
References 
Authors
0.34
21
3
Name
Order
Citations
PageRank
Bassem Seddik121.72
Gazzah, S.2106.21
Najoua Essoukri Ben Amara320941.48