Title
GVoS: A general system for near-duplicate video-related applications on storm
Abstract
The exponential increase of online videos greatly enriches the life of users but also brings huge numbers of near-duplicate videos (NDVs) that seriously challenge the video websites. The video websites entail NDV-related applications such as detection of copyright violation, video monitoring, video re-ranking, and video recommendation. Since these applications adopt different features and different processing procedures due to diverse scenarios, constructing separate and special-purpose systems for them incurs considerable costs on design, implementation, and maintenance. In this article, we propose a general NDV system on Storm (GVoS)-a popular distributed real-time stream processing platform-to simultaneously support a wide variety of video applications. The generality of GVoS is achieved in two aspects. First, we extract the reusable components from various applications. Second, we conduct the communication between components via a mechanism called Stream Shared Message (SSM) that contains the video-related data. Furthermore, we present an algorithm to reduce the size of SSM in order to avoid the data explosion and decrease the network latency. The experimental results demonstrate that GVoS can achieve performance almost the same as the customized systems. Meanwhile, GVoS accomplishes remarkably higher systematic versatility and efficiently facilitates the development of various NDV-related applications. © 2017 ACM.
Year
DOI
Venue
2017
10.1145/3041657
ACM Transactions on Information Systems
Keywords
Field
DocType
Near duplicate video,retrieval and detection,real-time processing,general system
Information retrieval,Computer science,Latency (engineering),Storm,Real-time computing,Video tracking,Stream processing,Generality
Journal
Volume
Issue
ISSN
36
1
1046-8188
Citations 
PageRank 
References 
1
0.35
37
Authors
6
Name
Order
Citations
PageRank
Jiawei Jiang18914.60
Yunhai Tong28013.33
Hua Lu3138083.74
Bin Cui41843124.59
Lei Kai515738.17
Lele Yu6706.93