Title
Determining the best suited semantic events for cognitive surveillance
Abstract
State-of-the-art systems on cognitive surveillance identify and describe complex events in selected domains, thus providing end-users with tools to easily access the contents of massive video footage. Nevertheless, as the complexity of events increases in semantics and the types of indoor/outdoor scenarios diversify, it becomes difficult to assess which events describe better the scene, and how to model them at a pixel level to fulfill natural language requests. We present an ontology-based methodology that guides the identification, step-by-step modeling, and generalization of the most relevant events to a specific domain. Our approach considers three steps: (1) end-users provide textual evidence from surveilled video sequences; (2) transcriptions are analyzed top-down to build the knowledge bases for event description; and (3) the obtained models are used to generalize event detection to different image sequences from the surveillance domain. This framework produces user-oriented knowledge that improves on existing advanced interfaces for video indexing and retrieval, by determining the best suited events for video understanding according to end-users. We have conducted experiments with outdoor and indoor scenes showing thefts, chases, and vandalism, demonstrating the feasibility and generalization of this proposal.
Year
DOI
Venue
2011
10.1016/j.eswa.2010.09.070
Expert Syst. Appl.
Keywords
Field
DocType
surveilled video sequence,video understanding,semantic event,event detection,event modeling,events increase,indoor scene,advanced user interfaces,ontologies,massive video footage,video indexing,cognitive surveillance,event description,complex event,content-based video retrieval,top down,natural language,user interface,knowledge base
Ontology (information science),Data mining,Transcription (linguistics),Ontology,Computer science,Search engine indexing,Natural language,Pixel,Cognition,Semantics
Journal
Volume
Issue
ISSN
38
4
Expert Systems With Applications
Citations 
PageRank 
References 
12
0.65
28
Authors
4
Name
Order
Citations
PageRank
C. Fernández1120.65
Pau Baiget2443.93
Xavier Roca31087.53
J. Gonzílez4191.11