Title
Integrating Multi-Stage Depth-Induced Contextual Information For Human Action Recognition And Localization
Abstract
Human action recognition and localization is a challenging vision task with promising applications. To tackle this problem, recently developed commodity depth sensor (e.g., Microsoft Kinect) has opened up new opportunities with several developed human motion features based on depth image for action representation. However, how depth information can be effectively adopted in the middle or high level representation in action detection, in particular, the depth induced three dimensional contextual information for modeling interactions between human-human, human-object and human-surroundings has yet been explored. In this paper, we propose a novel action recognition and localization framework which effectively fuses depth-induced contextual information from different levels of the processing pipeline for understanding various interactions. First, depth image is combined with grayscale image for more robust human subject and object detection. Second, three dimensional spatial and temporal relationship among human subjects or objects is represented based on the combination of grayscale and depth images. Third, depth information is further utilized to represent different types of indoor scenes. Finally, we fuse these multiple stage depth-induced contextual information to yield an unified action detection framework. Extensive experiments on a challenging grayscale + depth human action detection benchmark database demonstrate the effectiveness of the depth-induced contextual information and the high detection accuracy of the proposed framework.
Year
DOI
Venue
2013
10.1109/FG.2013.6553756
2013 10TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG)
Keywords
Field
DocType
context modeling,solid modeling,object recognition,gray scale,grayscale image,feature extraction,computer vision,image fusion
Object detection,Computer vision,Image fusion,Pattern recognition,Computer science,Feature extraction,Context model,Solid modeling,Artificial intelligence,Contextual image classification,Grayscale,Cognitive neuroscience of visual object recognition
Conference
Volume
Issue
ISSN
null
null
2326-5396
Citations 
PageRank 
References 
10
0.51
11
Authors
5
Name
Order
Citations
PageRank
Bingbing Ni1142182.90
Yong Pei2182.69
Zhujin Liang3392.00
Liang Lin43007151.07
Pierre Moulin51345103.49