Title
Complementary Cohort Strategy for Multimodal Face Pair Matching
Abstract
Face pair matching is the task of determining whether two face images represent the same person. Due to the limited expressive information embedded in the two face images as well as various sources of facial variations, it becomes a quite difficult problem. Toward the issue of few available images provided to represent each face, we propose to exploit an extra cohort set (identities in the cohort set are different from those being compared) by a series of cohort list comparisons. Useful cohort coefficients are then extracted from both sorted cohort identities and sorted cohort images for complementary information. To augment its robustness to complicated facial variations, we further employ multiple face modalities owing to their complementary value to each other for the face pair matching task. The final decision is made by fusing the extracted cohort coefficients with the direct matching score for all the available face modalities. To investigate the capacity of each individual modality on matching faces, the cohort behavior, and the performance achieved using our complementary cohort strategy, we conduct a set of experiments on two recently collected multimodal face databases. It is shown that using different modalities leads to different face pair matching performance. For each modality, employing our cohort scheme significantly reduces the equal error rate. By applying the proposed multimodal complementary cohort strategy, we achieve the best performance on our face pair matching task.
Year
DOI
Venue
2016
10.1109/TIFS.2015.2512561
IEEE Trans. Information Forensics and Security
Keywords
Field
DocType
Face,Face recognition,Databases,Sun,Training,Three-dimensional displays,Computer vision
Modalities,Computer vision,Facial recognition system,Pattern recognition,Image matching,Computer science,Image representation,Word error rate,Robustness (computer science),Speech recognition,Artificial intelligence,Cohort
Journal
Volume
Issue
ISSN
11
5
1556-6013
Citations 
PageRank 
References 
1
0.35
40
Authors
4
Name
Order
Citations
PageRank
Yunlian Sun1223.10
Kamal Nasrollahi233034.11
Zhenan Sun32379139.49
Tieniu Tan411681744.35