Title | ||
---|---|---|
Cross-Modal Cross-Domain Dual Alignment Network for RGB-Infrared Person Re-Identification |
Abstract | ||
---|---|---|
RGB-Infrared cross-modal person re-identification (Re-ID) has drawn increasing attention due to its application value in practice. Most of the current works rely on a supervised training manner. However, in real-world applications, manual collection of pair-wise RGB-Infrared (IR) person data is labor-intensive and time-consuming. Moreover, when a trained model is directly used in another domain, there is usually a significant performance drop. To overcome the above problems, we make the first attempt to transfer the learned model to a new RGB-IR domain which is unlabeled. The practical problem covers two kinds of challenges, i.e., cross-modal (RGB-Infrared) and cross-domain (different dataset) person Re-ID. Previous works have often considered only one of them either cross-modal or cross-domain. In this work, we propose a dual alignment network (DAN) to solve the RGB-Infrared cross-modal cross-domain person Re-ID problem. This network consists of three parts: Domain Adversarial Alignment component (DAA), Pseudo Label Generation module for target domain (PLG), and Cross-Modal Alignment component (CMA). These three modules complement and promote the model to learn domain-invariant and modality-invariant person representations. Further, we propose a protocol of cross-modal cross-domain person Re-ID by synthesizing target domains by adding random noise, adjusting the lighting intensity, and changing the background color, respectively. Experiments on real and synthetic datasets under the same cross-modalities across domains demonstrate the effectiveness of our method. |
Year | DOI | Venue |
---|---|---|
2022 | 10.1109/TCSVT.2022.3173263 | IEEE Transactions on Circuits and Systems for Video Technology |
Keywords | DocType | Volume |
Person Re-ID,domain adaptation,transfer learning,cross-modal learning | Journal | 32 |
Issue | ISSN | Citations |
10 | 1051-8215 | 0 |
PageRank | References | Authors |
0.34 | 24 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Xiaolan Fu | 1 | 786 | 60.72 |
f huang | 2 | 0 | 0.34 |
YuanChun Zhou | 3 | 104 | 25.99 |
Huadong Ma | 4 | 2020 | 179.93 |
Xin Xu | 5 | 1365 | 100.22 |