Title | ||
---|---|---|
Sequential training of semi-supervised classification based on sparse Gaussian process regression |
Abstract | ||
---|---|---|
Gaussian process regression (GPR) is a very important Bayesian approach in machine learning applications. It has been extensively used in semi-supervised learning tasks. In this paper, we propose a sequential training method for solving semi-supervised binary classification problem. It assigns targets to test inputs sequentially making use of sparse Gaussian process regression models. The proposed approach deals with only one part of the whole data set at a time. Firstly, the IVM produces a sparse approximation to a Gaussian process (GP) by combining assumed density filtering (ADF) with a heuristic for choosing points based on minimizing posterior entropy, and then a sparse GPR classifier is learnt on part of the whole data set. Secondly, the representative points selected in the first step including part of remainder examples are used to train another sparse GPR classifier. Repeat the two steps sequentially until all unlabeled examples are deal with. The proposed approach is simple and easy to implement. The hyperparameters are estimated easily by maximizing the marginal likelihood without resorting to expensive cross-validation technique. The evaluations of the proposed method on several real world data sets reveal promising results. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1109/ICMLC.2012.6359010 | ICMLC |
Keywords | Field | DocType |
assumed density filtering,sparse gaussian process regression,sparse gpr classifier,semisupervised learning tasks,marginal likelihood maximization,gaussian process (gp),gp,sequential training,bayes methods,learning (artificial intelligence),maximum likelihood estimation,assumed density filtering (adf),pattern classification,sequential training method,information vector machine (ivm),semisupervised classification,adf,gaussian processes,ivm,cross-validation technique,bayesian approach,posterior entropy minimization,machine learning applications,ground penetrating radar,learning artificial intelligence | Kriging,Heuristic,Pattern recognition,Hyperparameter,Binary classification,Computer science,Sparse approximation,Marginal likelihood,Artificial intelligence,Gaussian process,Classifier (linguistics),Machine learning | Conference |
Volume | ISSN | ISBN |
2 | 2160-133X | 978-1-4673-1484-8 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Rongqing Huang | 1 | 141 | 10.27 |
Shiliang Sun | 2 | 1732 | 115.55 |