Title
Combining Symbolic Reasoning and Deep Learning for Human Activity Recognition
Abstract
Activity recognition (AR) plays an important role in situation aware systems. Recently, deep learning approaches have shown promising results in the field of AR. However, their predictions are overconfident even in cases when the action class is incorrectly recognized. Moreover, these approaches provide information about an action class but not about the user context, such as location and manipulation of objects. To address these problems, we propose a hybrid AR architecture that combines deep learning with symbolic models to provide more realistic estimation of the classes and additional contextual information. We test the approach on a cooking dataset, describing the preparation of carrots soup. The results show that the proposed approach performs comparable to state of the art deep models inferring additional contextual properties about the current activity. The proposed approach is a first attempt to bridge the gap between deep learning and symbolic modeling for AR.
Year
DOI
Venue
2019
10.1109/PERCOMW.2019.8730792
2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)
Keywords
Field
DocType
Computational modeling,Computer architecture,Context modeling,Deep learning,Feature extraction,Activity recognition,Probabilistic logic
Architecture,Contextual information,Symbolic reasoning,Activity recognition,Computer science,Feature extraction,Context model,Artificial intelligence,Probabilistic logic,Deep learning,Machine learning,Distributed computing
Conference
ISSN
ISBN
Citations 
2474-2503
978-1-5386-9151-9
1
PageRank 
References 
Authors
0.35
0
6
Name
Order
Citations
PageRank
Fernando Moya Rueda172.89
Stefan Lüdtke235.15
Max Schröder345.86
Kristina Yordanova47015.22
Thomas Kirste5769.35
G. A. Fink611814.89