Abstract | ||
---|---|---|
In order to improve the limitation of single-mode biometric identification technology, a bimodal biometric verification system based on deep learning is proposed in this paper. A modified CNN architecture is used to generate better facial feature for bimodal fusion. The obtained facial feature and acoustic feature extracted by the acoustic feature extraction model are fused together to form the fusion feature on feature layer level. The fusion feature obtained by this method are used to train a neural network of identifying the target person who have these corresponding features. Experimental results demonstrate the superiority and high performance of our bimodal biometric in comparison with single-mode biometrics for identity authentication, which are tested on a bimodal database consists of data coherent from TED-LIUM and CASIA-WebFace. Compared with using facial feature or acoustic feature alone, the classification accuracy of fusion feature obtained by our method is increased obviously. |
Year | DOI | Venue |
---|---|---|
2017 | 10.1145/3177404.3177410 | PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2017) |
Keywords | Field | DocType |
identity authentication, multi-modal biometrics, feature fusion, deep learning, convolutional neural networks | Authentication,Pattern recognition,Convolutional neural network,Computer science,Fusion,Feature extraction,Artificial intelligence,Biometrics,Deep learning,Artificial neural network,Verification system | Conference |
Citations | PageRank | References |
0 | 0.34 | 6 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Baolin Song | 1 | 2 | 0.75 |
hao jiang | 2 | 59 | 17.96 |
Li Zhao | 3 | 198 | 22.70 |
Chengwei Huang | 4 | 20 | 3.81 |