Name
Abstract | ||
|---|---|---|
In some classification problems there is prior information about the joint relevance of groups of features. This knowledge can be encoded in a network whose nodes correspond to features and whose edges connect features that should be either both excluded or both included in the predictive model. In this paper, we introduce a novel network-based sparse Bayesian classifier (NBSBC) that makes use of the information about feature dependencies encoded in such a network to improve its prediction accuracy, especially in problems with a high-dimensional feature space and a limited amount of available training data. Approximate Bayesian inference is efficiently implemented in this model using expectation propagation. The NBSBC method is validated on four real-world classification problems from different domains of application: phonemes, handwritten digits, precipitation records and gene expression measurements. A comparison with state-of-the-art methods (support vector machine, network-based support vector machine and graph lasso) show that NBSBC has excellent predictive performance. It has the best accuracy in three of the four problems analyzed and ranks second in the modeling of the precipitation data. NBSBC also yields accurate and robust rankings of the individual features according to their relevance to the solution of the classification problem considered. The accuracy and stability of these estimates is an important factor in the good overall performance of this method. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1016/j.patcog.2010.10.016 | Pattern Recognition |
Keywords | Field | DocType |
network-based sparse bayesian classification,markov random field,excellent predictive performance,prediction accuracy,real-world classification problem,high-dimensional feature space,good overall performance,approximate bayesian inference,feature selection,expectation propagation,available training data,best accuracy,network based classification,classification problem,spike and slab,sparsity,nbsbc method,bayesian classifier,gene expression,feature space,prediction model,bayesian classification,support vector machine | Feature vector,Bayesian inference,Feature selection,Naive Bayes classifier,Pattern recognition,Computer science,Lasso (statistics),Support vector machine,Artificial intelligence,Expectation propagation,Relevance vector machine,Machine learning | Journal |
Volume | Issue | ISSN |
44 | 4 | Pattern Recognition |
Citations | PageRank | References |
9 | 0.71 | 27 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| José Miguel Hernández-Lobato | 1 | 613 | 49.06 |
| Daniel Hernández-Lobato | 2 | 440 | 26.10 |
| Alberto Suárez | 3 | 137 | 6.28 |