Title
Joint Feature Disentanglement and Hallucination for Few-Shot Image Classification
Abstract
Few-shot learning (FSL) refers to the learning task that generalizes from base to novel concepts with only few examples observed during training. One intuitive FSL approach is to hallucinate additional training samples for novel categories. While this is typically done by learning from a disjoint set of base categories with sufficient amount of training data, most existing works did not fully exploit the intra-class information from base categories, and thus there is no guarantee that the hallucinated data would represent the class of interest accordingly. In this paper, we propose Feature Disentanglement and Hallucination Network (FDH-Net), which jointly performs feature disentanglement and hallucination for FSL purposes. More specifically, our FDH-Net is able to disentangle input visual data into class-specific and appearance-specific features. With both data recovery and classification constraints, hallucination of image features for novel categories using appearance information extracted from base categories can be achieved. We perform extensive experiments on two fine-grained datasets (CUB and FLO) and two coarse-grained ones (mini-ImageNet and CIFAR-100). The results confirm that our framework performs favorably against state-of-the-art metric-learning and hallucination-based FSL models.
Year
DOI
Venue
2021
10.1109/TIP.2021.3124322
IEEE TRANSACTIONS ON IMAGE PROCESSING
Keywords
DocType
Volume
Task analysis, Feature extraction, Visualization, Training, Data models, Data mining, Birds, Few-shot learning (FSL), image classification, data hallucination, feature disentanglement
Journal
30
Issue
ISSN
Citations 
1
1057-7149
0
PageRank 
References 
Authors
0.34
7
4
Name
Order
Citations
PageRank
Chia-Ching Lin100.34
Hsin-Li Chu200.34
Yu-Chiang Frank Wang391461.63
Chin-Laung Lei41686201.07