Title
Adaptive And Robust Partition Learning For Person Retrieval With Policy Gradient
Abstract
Person retrieval aims at effectively matching the pedestrian images over an extensive database given a specified identity. As extracting effective features is crucial in a high-performance retrieval system, recent significant progress was achieved by part-based models that have constructed robust local representations on top of vertically striped part features. However, this kind of models use predefined partitioning strategies, making the number and size of each partition identical even when input images vary a lot. This unchangeable setting usually leads to less flexibility and robustness in capturing visual variance. The primary reason for such a negative effect is that a fixed partitioning strategy is unable to deal with (a) the significant variance from pose, illumination and viewpoint which is common in a pedestrian image dataset, and (b) also the inference error and misalignment of human bodies introduced by the prepositive pedestrian detection module or human pose estimation module. In this paper, we tackle this problem via introducing the novel Adaptive Partition Network (APN). The APN utilizes deep reinforcement learning and applies an agent to generate optimal partitioning strategies dynamically for different input images. The agent inside the APN is optimized with the policy gradient algorithm and maximizes the reward of choosing the best partition setting. By leveraging the supervision cues from the objective partitioning strategies that are generated on a set of held-out training images, the agent is trained jointly with other parts of APN, which ensures the APN's robustness and generalization ability. Extensive experimental results on multiple datasets, including CUHK03, DukeMTMC and Market-1501, demonstrate the superiority of APN over the state-of-the-art models.
Year
DOI
Venue
2021
10.1109/TMM.2020.3023272
IEEE TRANSACTIONS ON MULTIMEDIA
Keywords
DocType
Volume
Feature extraction, Adaptation models, Robustness, Pose estimation, Adaptive systems, Training, Computational modeling, Adaptive partition network, person re-identification (re-id), person retrieval, reinforcement learning
Journal
23
ISSN
Citations 
PageRank 
1520-9210
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Yuxuan Shi1165.34
Zhen Wei2244.09
Hefei Ling324139.63
Ziyang Wang482.49
Pengfei Zhu524931.05
Jialie Shen651.48
Ping Li7124.61