Title
Probabilistic Reasoning for Unique Role Recognition Based on the Fusion of Semantic-Interaction and Spatio-Temporal Features
Abstract
This paper deals with the problem of recognizing the unique role in dynamic environments. Different from social roles, the unique role refers to those who are unusual in their carrying items or movements in the scene. In this paper, we propose a hierarchical probabilistic reasoning method that relates spatial relationships between interested objects and humans with their temporal changes to recognize the unique individual. Two observation models, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Object Existence Model (OEM)</italic> and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Human Action Model (HAM)</italic> , are established to support role inference by analyzing the corresponding semantic-interaction features and spatio-temporal features. Then, OEM and HAM results of each person are compared with the overall distribution in the scene, respectively. Finally, we can determine the role through the fusion of two observation models. Experiments are conducted in both indoor and outdoor environments concerning different settings, degrees of clutter, and occlusions. The results show that the proposed method can adapt to a variety of scenarios and outperforms other methods on accuracy and robustness, moreover, exhibiting stable performance even in complex scenes.
Year
DOI
Venue
2019
10.1109/tmm.2018.2875513
IEEE Transactions on Multimedia
Keywords
Field
DocType
Probabilistic logic,Semantics,Cognition,Decision making,Three-dimensional displays,Sensors,Analytical models
Pattern recognition,Clutter,Computer science,Inference,Original equipment manufacturer,Robustness (computer science),Artificial intelligence,Probabilistic logic,Cognition,Human action cycle,Machine learning,Semantics
Journal
Volume
Issue
ISSN
21
5
1520-9210
Citations 
PageRank 
References 
1
0.37
0
Authors
5
Name
Order
Citations
PageRank
Chule Yang162.28
Yufeng Yue285.73
Jun Zhang31102188.11
Mingxing Wen425.44
Danwei Wang51529175.13