Paper Info
Title
Keyframe Extraction Based On Face Quality Measurement And Convolutional Neural Network For Efficient Face Recognition In Videos
Abstract
Indexing is the process of extracting a compact, significant and pertinent signature that describes the content of the data. This field has a broad spectrum of promising applications, such as the Face in Video Recognition (FiVR). Motivating the interest of researchers around the world. Since the video has a huge amount of data, the process of extracting the relevant frames becomes necessary and an essential step prior to performing face recognition. In this context, we propose a new method for extracting keyframes from videos based on face quality and deep learning for a face recognition task. The first step is the face detection using MTCNN detector, which detects five landmarks (the eyes, the two corners of the mouth and the nose). It limits face boundaries in a bounding box, and provides a confidence score. This method has two steps. The first step aims to generate the face quality score of each face in the data set prepared for the learning step. To generate quality scores, we use three face feature extractor including Gabor, LBP and HoG. The second step consist on training a deep Convolutional Neural Network in a supervised manner in order to select frames having the best face quality. The obtained results show the effectiveness of the proposed method compared to the methods of the state of the art.
Year
DOI
Venue
2021
10.1007/s11042-020-09385-5
MULTIMEDIA TOOLS AND APPLICATIONS
Keywords
DocType
Volume
Keyframe extraction, Face quality assessment, Face in Video Recognition, Convolution Neural Network, Content Based Video Retrieval
Journal
80
Issue
ISSN
Citations 
15
1380-7501
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Rahma Abed100.34
Sahbi Bahroun243.46
Zagrouba, E.3186.07