Title
Scalable Hash From Triplet Loss Feature Aggregation For Video De-duplication
Abstract
The producing, sharing and consuming life cycle of video content creates massive amount of duplicates in video segments due to variable bit rate representation and fragmentation in the playbacks. The inefficiency of this duplicates to storage and communication motivate researchers in both academia and industry to come up with computationally efficient video deduplication solutions for storage and CDN providers. Moreover, the increasing demands of high resolution and quality aggravate the status of heavy burden of cluster storage side and restricted bandwidth resources. Hence, video de-duplication in storage and transmission is becoming an important feature for video cloud storage and Content Delivery Network (CDN) service providers. Despite of the necessity of optimizing the multimedia data de-duplication approach, it is a challenging task because we should match as many as possible duplicated videos under not removing videos by mistake. The current video de-duplication schemes mostly relies on the URL based solution, which is not able to deal with non-cacheable content like video, which the same piece of content may have totally different URL identification and fragmentation and different quality representations further complicate the problem. In this paper, we propose a novel content based video segmentation identification scheme that is invariant to the underlying codec and operational bit rates, it computes robust features from a triplet loss deep learning network that captures the invariance of the same content under different coding tools and strategy, while a scalable hashing solution is developed based on Fisher Vector aggregation of the convolutional features from the Triplet loss network. Our simulation results demonstrate the great improvement in terms of large scale video repository de-duplication compared with state-of-the-art methods.
Year
DOI
Venue
2020
10.1016/j.jvcir.2020.102908
Journal of Visual Communication and Image Representation
Keywords
DocType
Volume
41A05,41A10,65D05,65D17
Journal
72
ISSN
Citations 
PageRank 
1047-3203
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Wei Jia101.69
Li Li26821.99
Zhu Li394082.17
zhao shuai4439.42
shan liu59649.62