Title
Efficient parameter learning of Bayesian network classifiers.
Abstract
Recent advances have demonstrated substantial benefits from learning with both generative and discriminative parameters. On the one hand, generative approaches address the estimation of the parameters of the joint distribution—, which for most network types is very computationally (a notable exception to this are Markov networks) and on the other hand, discriminative approaches address the estimation of the parameters of the posterior distribution—and, are more for classification, since they fit directly. However, discriminative approaches are less computationally efficient as the normalization factor in the conditional log-likelihood precludes the derivation of closed-form estimation of parameters. This paper introduces a new discriminative parameter learning method for Bayesian network classifiers that combines in an elegant fashion parameters learned using both generative and discriminative methods. The proposed method is discriminative in nature, but uses estimates of generative probabilities to speed-up the optimization process. A second contribution is to propose a simple framework to characterize the parameter learning task for Bayesian network classifiers. We conduct an extensive set of experiments on 72 standard datasets and demonstrate that our proposed discriminative parameterization provides an efficient alternative to other state-of-the-art parameterizations.
Year
DOI
Venue
2017
https://doi.org/10.1007/s10994-016-5619-z
Machine Learning
Field
DocType
Volume
Normalization (statistics),Parametrization,Pattern recognition,Markov chain,Parameter learning,Bayesian network,Artificial intelligence,Generative grammar,Discriminative model,Machine learning,Mathematics,Generative model
Journal
106
Issue
ISSN
Citations 
9-10
0885-6125
1
PageRank 
References 
Authors
0.35
19
7
Name
Order
Citations
PageRank
Nayyar Abbas Zaidi1919.88
Geoffrey I. Webb29912.05
Mark Carman356349.18
François Petitjean447434.26
Wray L. Buntine52271579.82
Mike Hynes610.35
Hans De Sterck720426.14