Title
Experiments on an RGB-D Wearable Vision System for Egocentric Activity Recognition
Abstract
This work describes and explores novel steps towards activity recognition from an egocentric point of view. Activity recognition is a broadly studied topic in computer vision, but the unique characteristics of wearable vision systems present new challenges and opportunities. We evaluate a challenging new publicly available dataset that includes trajectories of different users across two indoor environments performing a set of more than 20 different activities. The visual features studied include compact and global image descriptors, including GIST and a novel skin segmentation based histogram signature, and state-of-the art image representations for recognition, including Bag of SIFT words and Convolutional Neural Network (CNN) based features. Our experiments show that simple and compact features provide reasonable accuracy to obtain basic activity information (in our case, manipulation vs. non-manipulation). However, for finer grained categories CNN-based features provide the most promising results. Future steps include integration of depth information with these features and temporal consistency into the pipeline.
Year
DOI
Venue
2014
10.1109/CVPRW.2014.94
CVPR Workshops
Keywords
Field
DocType
global image descriptors,image representation,rgb-d wearable vision system,bag of sift words,skin segmentation,histogram signature,image segmentation,convolutional neural network,image recognition,image sensors,gist,image representations,computer vision,egocentric activity recognition,activity information,neural nets,compact image descriptors,cnn-based features,skin,sensors,histograms
Computer vision,Activity recognition,Automatic image annotation,Feature detection (computer vision),Machine vision,Pattern recognition,Bag-of-words model in computer vision,Image texture,Computer science,Convolutional neural network,Image segmentation,Artificial intelligence
Conference
ISSN
Citations 
PageRank 
2160-7508
15
0.62
References 
Authors
16
5
Name
Order
Citations
PageRank
Mohammad Moghimi1150.62
Pablo Azagra2160.99
L. Montesano365342.58
Ana C. Murillo4544.44
Serge J. Belongie5125121010.13