Name
Abstract | ||
|---|---|---|
Decision trees are comprehensible, but at the cost of a relatively lower prediction accuracy compared to other powerful black-box classifiers such as SVMs. Boosting has been a popular strategy to create an ensemble of decision trees to improve their classification performance, but at the expense of comprehensibility advantage. To this end, alternating decision tree (ADTree) has been proposed to allow boosting within a single decision tree to retain comprehension. However, existing ADTrees are univariate, which limits their applicability. This research proposes a novel algorithm - multivariate ADTree. It presents and discusses its different variations (Fisher's ADTree, Sparse ADTree, and Regularized Logistic ADTree) along with their empirical validation on a set of publicly available datasets. It is shown that multivariate ADTree has high prediction accuracy comparable to that of decision tree ensembles, while retaining good comprehension which is close to comprehension of individual univariate decision trees. Novel concept of multivariate alternating decision tree (ADTree) with boosting.Offering high prediction accuracy similar to decision tree ensembles.Retaining good comprehension similar to individual univariate decision trees.Bridging powerful regularization techniques to decision tree research.Introduction and validation of multivariate ADTree algorithms on public datasets. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1016/j.patcog.2015.08.014 | Pattern Recognition |
Keywords | Field | DocType |
Alternating decision tree,Boosting,Multivariate decision tree,Lasso,LARS | Data mining,Decision tree,Computer science,Artificial intelligence,Alternating decision tree,Pattern recognition,Multivariate statistics,Support vector machine,Boosting (machine learning),Univariate,Machine learning,Decision tree learning,Incremental decision tree | Journal |
Volume | Issue | ISSN |
50 | C | 0031-3203 |
Citations | PageRank | References |
7 | 0.53 | 18 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Hong Kuan Sok | 1 | 15 | 1.80 |
| Melanie Po-Leen Ooi | 2 | 70 | 18.35 |
| Ye Chow Kuang | 3 | 72 | 19.81 |
| Serge N. Demidenko | 4 | 84 | 19.38 |