Title
A Unified Framework for Event Summarization and Rare Event Detection from Multiple Views
Abstract
A novel approach for event summarization and rare event detection is proposed. Unlike conventional methods that deal with event summarization and rare event detection independently, our method solves them in a single framework by transforming them into a graph editing problem. In our approach, a video is represented by a graph, each node of which indicates an event obtained by segmenting the video spatially and temporally. The edges between nodes describe the relationship between events. Based on the degree of relations, edges have different weights. After learning the graph structure, our method finds subgraphs that represent event summarization and rare events in the video by editing the graph, that is, merging its subgraphs or pruning its edges. The graph is edited to minimize a predefined energy model with the Markov Chain Monte Carlo (MCMC) method. The energy model consists of several parameters that represent the causality, frequency, and significance of events. We design a specific energy model that uses these parameters to satisfy each objective of event summarization and rare event detection. The proposed method is extended to obtain event summarization and rare event detection results across multiple videos captured from multiple views. For this purpose, the proposed method independently learns and edits each graph of individual videos for event summarization or rare event detection.. Then, the method matches the extracted multiple graphs to each other, and constructs a single composite graph that represents event summarization or rare events from multiple views. Experimental results show that the proposed approach accurately summarizes multiple videos in a fully unsupervised manner. Moreover, the experiments demonstrate that the approach is advantageous in detecting rare transition of events.
Year
DOI
Venue
2015
10.1109/TPAMI.2014.2385695
Pattern Analysis and Machine Intelligence, IEEE Transactions  
Keywords
Field
DocType
event summarization,rare event detection,video structure editing,video structure learning,video structure matching,pattern analysis
Data mining,Automatic summarization,Graph,Markov chain Monte Carlo,Pattern recognition,Computer science,Rare event detection,Pattern analysis,Artificial intelligence,Merge (version control),Rare events
Journal
Volume
Issue
ISSN
PP
99
0162-8828
Citations 
PageRank 
References 
9
0.52
40
Authors
2
Name
Order
Citations
PageRank
Junseok Kwon190.52
Kyoung Mu Lee23228153.84