Title
Sequential training of semi-supervised classification based on sparse Gaussian process regression
Abstract
Gaussian process regression (GPR) is a very important Bayesian approach in machine learning applications. It has been extensively used in semi-supervised learning tasks. In this paper, we propose a sequential training method for solving semi-supervised binary classification problem. It assigns targets to test inputs sequentially making use of sparse Gaussian process regression models. The proposed approach deals with only one part of the whole data set at a time. Firstly, the IVM produces a sparse approximation to a Gaussian process (GP) by combining assumed density filtering (ADF) with a heuristic for choosing points based on minimizing posterior entropy, and then a sparse GPR classifier is learnt on part of the whole data set. Secondly, the representative points selected in the first step including part of remainder examples are used to train another sparse GPR classifier. Repeat the two steps sequentially until all unlabeled examples are deal with. The proposed approach is simple and easy to implement. The hyperparameters are estimated easily by maximizing the marginal likelihood without resorting to expensive cross-validation technique. The evaluations of the proposed method on several real world data sets reveal promising results.
Year
DOI
Venue
2012
10.1109/ICMLC.2012.6359010
ICMLC
Keywords
Field
DocType
assumed density filtering,sparse gaussian process regression,sparse gpr classifier,semisupervised learning tasks,marginal likelihood maximization,gaussian process (gp),gp,sequential training,bayes methods,learning (artificial intelligence),maximum likelihood estimation,assumed density filtering (adf),pattern classification,sequential training method,information vector machine (ivm),semisupervised classification,adf,gaussian processes,ivm,cross-validation technique,bayesian approach,posterior entropy minimization,machine learning applications,ground penetrating radar,learning artificial intelligence
Kriging,Heuristic,Pattern recognition,Hyperparameter,Binary classification,Computer science,Sparse approximation,Marginal likelihood,Artificial intelligence,Gaussian process,Classifier (linguistics),Machine learning
Conference
Volume
ISSN
ISBN
2
2160-133X
978-1-4673-1484-8
Citations 
PageRank 
References 
0
0.34
0
Authors
2
Name
Order
Citations
PageRank
Rongqing Huang114110.27
Shiliang Sun21732115.55