Title
Anytime induction of low-cost, low-error classifiers: a sampling-based approach
Abstract
Machine learning techniques are gaining prevalence in the production of a wide range of classifiers for complex real-world applications with nonuniform testing and misclassification costs. The increasing complexity of these applications poses a real challenge to resource management during learning and classification. In this work we introduce ACT (anytime cost-sensitive tree learner), a novel framework for operating in such complex environments. ACT is an anytime algorithm that allows learning time to be increased in return for lower classification costs. It builds a tree top-down and exploits additional time resources to obtain better estimations for the utility of the different candidate splits. Using sampling techniques, ACT approximates the cost of the subtree under each candidate split and favors the one with a minimal cost. As a stochastic algorithm, ACT is expected to be able to escape local minima, into which greedy methods may be trapped. Experiments with a variety of datasets were conducted to compare ACT to the state-of-the-art cost-sensitive tree learners. The results show that for the majority of domains ACT produces significantly less costly trees. ACT also exhibits good anytime behavior with diminishing returns.
Year
DOI
Venue
2014
10.1613/jair.2602
Journal of Artificial Intelligence Research
Keywords
DocType
Volume
additional time resource,complex environment,tree top-down,domains act,sampling-based approach,low-error classifier,candidate split,state-of-the-art cost-sensitive tree learner,cost-sensitive tree learner,complex real-world application,costly tree,different candidate split,machine learning,sampling technique,resource manager,top down,local minima
Journal
abs/1401.3447
Issue
ISSN
Citations 
1
Journal Of Artificial Intelligence Research, Volume 33, pages 1-31, 2008
5
PageRank 
References 
Authors
0.42
38
54
Name
Order
Citations
PageRank
Saher Esmeir117214.81
Shaul Markovitch23010262.77
Benjamin Lubin312110.24
Adam I. Juda412511.05
Ruggiero Cavallo519618.91
sebastien lahaie650.42
Jeffrey Shneidman752434.37
David C. Parkes83293342.69
David Martínez920515.41
o lopez de lacalle1050.42
eneko agirre1150.42
yaakov gal1250.42
Avi Pfeffer131621302.61
Reshef Meir1434433.65
Ariel D. Procaccia151875148.20
Jeffrey S. Rosenschein162781527.83
Aviv Zohar1768558.61
De Laet, T.18162.23
j de schutter1950.42
Herman Bruyninckx20893108.95
Tal Grinshpoun2111615.28
Amnon Meisels22803112.54
Iead Rezek238516.16
David S. Leslie2416513.75
Steven Reece2513311.51
stephen j roberts261244174.70
alex rogers272500183.76
Rajdeep K. Dash2828722.70
Nicholas R. Jennings29193481564.35
Antonis C. Kakas30127797.13
Paolo Mancarella3172853.45
Fariba Sadri321475173.43
Kostas Stathis3348848.22
francesca toni3490.83
eyal amir3550.42
aidong chang3650.42
jeffrey d goldsmith3750.42
j lang3890.85
Miroslaw Truszczynski391494162.36
nick wilson4050.42
dongheng zhang4150.42
yanbin zhang42746.70
Robert Mateescu4319312.42
Rina Dechter445387703.16
Radu Marinescu4593769.41
Sherief Abdallah4636927.29
victor lesser4790.83
s de jong4850.42
simon uyttendaele4950.42
Karl Tuyls501272127.83
  • 1
  • 2