Title
Zero and Few Shot Learning with Semantic Feature Synthesis and Competitive Learning.
Abstract
Zero-shot learning (ZSL) is made possible by learning a projection function between a feature space and a semantic space (e.g.,~an attribute space). Key to ZSL is thus to learn a projection that is robust against the often large domain gap between the seen and unseen class domains. In this work, this is achieved by unseen class data synthesis and robust projection function learning. Specifically, a novel semantic data synthesis strategy is proposed, by which semantic class prototypes (e.g., attribute vectors) are used to simply perturb seen class data for generating unseen class ones. As in any data synthesis/hallucination approach, there are ambiguities and uncertainties on how well the synthesised data can capture the targeted unseen class data distribution. To cope with this, the second contribution of this work is a novel projection learning model termed competitive bidirectional projection learning (BPL) designed to best utilise the ambiguous synthesised data. Specifically, we assume that each synthesised data point can belong to any unseen class; and the most likely two class candidates are exploited to learn a robust projection function in a competitive fashion. As a third contribution, we show that the proposed ZSL model can be easily extended to few-shot learning (FSL) by again exploiting semantic (class prototype guided) feature synthesis and competitive BPL. Extensive experiments show that our model achieves the state-of-the-art results on both problems.
Year
Venue
Field
2018
arXiv: Computer Vision and Pattern Recognition
Competitive learning,Feature vector,Computer science,Projection (set theory),Data synthesis,Artificial intelligence,Semantic feature,Machine learning,Semantic data model,Semantic space
DocType
Volume
Citations 
Journal
abs/1810.08332
1
PageRank 
References 
Authors
0.40
35
6
Name
Order
Citations
PageRank
Zhiwu Lu112.09
Jiechao Guan210.73
aoxue li3356.26
Tao Xiang44929215.84
An Zhao581.51
Ji-Rong Wen64431265.98