Title
How many cases do you need? assessing and predicting case-base coverage
Abstract
Case acquisition is the primary learning method for case-based reasoning (CBR), and the ability of a CBR system's case-base to cover the problems it encounters is a crucial factor in its performance. Consequently, the ability to assess the current level of case-base coverage and to predict the incremental benefit of adding cases could play an important role in guiding the case acquisition process. This paper demonstrates that such tasks require different strategies from those of existing competence models, whose aim is to guide selection of competent cases from a known pool of cases. This paper presents initial steps on developing methods for predicting how unseen future cases will affect a system's case-base. It begins by discussing case coverage as defined in prior research, especially in methods based on the representativeness hypothesis. It then compares alternative methods for assessing case-base coverage, including a new Monte-Carlo method for prediction early in case-base growth. It evaluates the performance of these approaches for three tasks: estimating competence, predicting the incremental benefit of acquiring new cases, and predicting the total number of cases required to achieve maximal coverage.
Year
DOI
Venue
2011
10.1007/978-3-642-23291-6_9
ICCBR
Keywords
Field
DocType
competent case,incremental benefit,unseen future case,case-base coverage,new case,case-base growth,case acquisition process,case acquisition,case coverage,maximal coverage
Data mining,Computer science,Representativeness heuristic,Case base,Artificial intelligence,Machine learning
Conference
Volume
ISSN
Citations 
6880
0302-9743
7
PageRank 
References 
Authors
0.50
6
2
Name
Order
Citations
PageRank
David B. Leake11369121.60
Mark Wilson270.50