Name
Abstract | ||
|---|---|---|
In this paper, we will introduce three frameworks for multimodal biometric using sparse representation based classification (SRC), which has been successfully used in many classification tasks recently. The first framework is multimodal SRC at match score level (MSRC_s), in which feature of each modality is sparsely coded independently, and then their representation fidelities are used as match scores for multimodal classification. The other two frameworks are multimodal SRC at feature level (MSRC_f1, MSRC_f2), where features of all modalities are first fused and then classified by using SRC. The difference between them is that MSRC_f1 fuses the features to form a unique multimodal feature vector, while MSRC_f2 implicitly combines the features in an iterative joint sparse coding process. As a typical application, the fusion of face and ear for human identification is investigated by using the three frameworks. In our experiments, Principal Component Analysis (PCA) based feature extraction is applied. Many results demonstrate that the proposed multimodal methods are significantly better than the multimodal recognition using common classifiers. Among the SRC based methods, MSRC_s gets the top recognition accuracy in almost all the test items, which might benefit from allowing sparse coding independence for different modalities. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1007/978-3-642-36669-7_53 | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Keywords | Field | DocType |
unique multimodal feature vector,multimodal classification,classification task,feature extraction,multimodal recognition,sparse coding,multimodal biometric,iterative joint sparse,proposed multimodal method,feature level,multimodal src,sparse representation | Feature vector,Pattern recognition,Neural coding,Computer science,Sparse approximation,Feature extraction,Speech recognition,Artificial intelligence,Biometrics,Principal component analysis | Conference |
Volume | Issue | ISSN |
7751 LNCS | null | 16113349 |
Citations | PageRank | References |
1 | 0.35 | 6 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Zengxi Huang | 1 | 32 | 3.52 |
| Yiguang Liu | 2 | 338 | 37.15 |
| Ronggang Huang | 3 | 16 | 3.38 |
| Menglong Yang | 4 | 109 | 10.49 |