Title
Fake Face Images Detection and Identification of Celebrities Based on Semantic Segmentation
Abstract
Convolutional Neural Networks (CNN) based detectors perform well in face manipulation detection, but are still limited by redundant information. Some methods focus on blending boundary to localize manipulation regions, discarding a part of useless information like background of image. But these methods still contain deceptive information such as facial regions without texture, which occupies resources and affects detection accuracy. Besides, these methods left out some features useful for identification. Therefore, this paper proposes a module by conducting semantic masks to guide detectors focus on face. The semantic segmentation masks focus on the facial features such as hair, eyes and other important areas, which can offer effective face identification high level semantic features. Our method uses masks as an attention-based data augmentation module and is simple for many DeepFake detection models to integrate. Experiments on multiple detectors with and without our module show our module's effectiveness. Without modifying their structural design, our approach enables CNN-based detectors to perform better. Especially, our method is well-suited for protecting the person of interest against face forgery.
Year
DOI
Venue
2022
10.1109/LSP.2022.3205481
IEEE SIGNAL PROCESSING LETTERS
Keywords
DocType
Volume
Semantics, Faces, Detectors, Image segmentation, Forgery, Task analysis, Feature extraction, Convolutional neural network (CNN), face manipulation detection, identification of persons, semantic segmentation
Journal
29
ISSN
Citations 
PageRank 
1070-9908
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Renying Wang100.68
Zhen Yang253.46
Weike You300.68
jing412220.75
Beilin Chu500.68