Title
Deep Fourier Ranking Quantization for Semi-Supervised Image Retrieval
Abstract
To reduce the extreme label dependence of supervised product quantization methods, the semi-supervised paradigm usually employs massive unlabeled data to assist in regularizing deep networks, thereby improving model performance. However, the existing method focuses on the overall distribution consistency between unlabeled data and class prototypes, while ignoring subtle individual variances between unlabeled instances. Therefore, the local neighborhood structure is not fully explored, which will cause the model to easily overfit in the training set. In this paper, we introduce a new Fourier perspective to alleviate this issue by exploring the semantic relations between unlabeled instances in a self-supervised manner. Specifically, based on Fourier Transform, we first design a Phase Mixing (PM) strategy, which can manipulate the mixing area and values of the phase component between two images to control the proportion of semantic information. In this way, we can construct multi-level similarity neighbors naturally for unlabeled data. Then, a ranking quantization loss is formulated to perceive multi-level semantic variances in neighbor instances, which improves the robustness and generalization of the model. Extensive experiments in three different semi-supervised settings show that our method outperforms existing state-of-the-art methods by averaged 3.95% improvement on four datasets.
Year
DOI
Venue
2022
10.1109/TIP.2022.3203612
IEEE TRANSACTIONS ON IMAGE PROCESSING
Keywords
DocType
Volume
Quantization (signal), Semantics, Data models, Task analysis, Convolutional neural networks, Image reconstruction, Hash functions, Image retrieval, semi-supervised product quantization, Fourier ranking, phase mixing
Journal
31
Issue
ISSN
Citations 
1
1057-7149
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Pandeng Li100.68
Hongtao Xie243947.79
Shaobo Min3186.70
Jiannan Ge401.35
Xun Chen545852.73
Yongdong Zhang62544166.91