Title
Applying Bayesian approach to decision tree
Abstract
Applying Bayesian approach to decision tree (DT) model, and then a Bayesian-inference-based decision tree (BDT) model is proposed. For BDT we assign prior to the model parameters. Together with observed samples, prior are converted to posterior through Bayesian inference. When making inference we resort to simulation methods using reversible jump Markov chain Monte Carlo (RJMCMC) since the dimension of posterior distribution is varying. Compared with DT, BDT enjoys the following three advantages. Firstly, the model's learning procedure is implemented with sampling instead of a series of splitting and pruning operations. Secondly, the model provides output that gives insight into different tree structures and recursive partition of the decision space, resulting in better classification accuracy. And thirdly, the model can indicate confidence that the sample belongs to a particular class in classification. The experiments on music style classification demonstrate the efficiency of BDT.
Year
DOI
Venue
2006
10.1007/978-3-540-37275-2_37
ICIC (2)
Keywords
Field
DocType
recursive partitioning,posterior distribution,tree structure,bayesian approach,decision tree,bayesian inference
Decision tree,Bayesian inference,Pattern recognition,Computer science,Tree (data structure),Reversible-jump Markov chain Monte Carlo,Posterior probability,Artificial intelligence,Tree structure,Machine learning,Incremental decision tree,Bayesian probability
Conference
Volume
Issue
ISSN
4114 LNAI - II
null
0302-9743
ISBN
Citations 
PageRank 
3-540-37274-1
2
0.36
References 
Authors
4
3
Name
Order
Citations
PageRank
Yatong Zhou1285.72
Taiyi Zhang217617.60
Zhigang Chen3214.07