Title
Extending WHIRL with background knowledge for improved text classification
Abstract
Intelligent use of the many diverse forms of data available on the Internet requires new tools for managing and manipulating heterogeneous forms of information. This paper uses WHIRL, an extension of relational databases that can manipulate textual data using statistical similarity measures developed by the information retrieval community. We show that although WHIRL is designed for more general similarity-based reasoning tasks, it is competitive with mature systems designed explicitly for inductive classification. In particular, WHIRL is well suited for combining different sources of knowledge in the classification process. We show on a diverse set of tasks that the use of appropriate sets of unlabeled background knowledge often decreases error rates, particularly if the number of examples or the size of the strings in the training set is small. This is especially useful when labeling text is a labor-intensive job and when there is a large amount of information available about a particular problem on the World Wide Web.
Year
DOI
Venue
2007
10.1007/s10791-006-9004-6
Inf. Retr.
Keywords
Field
DocType
Text categorization,Background knowledge,Semi-supervised learning,Information retrieval,Query processing
Data mining,Semi-supervised learning,Relational database,Computer science,Artificial intelligence,Text categorization,Word processing,The Internet,Training set,Categorization,Information retrieval,Computational linguistics,Machine learning
Journal
Volume
Issue
ISSN
10
1
1386-4564
Citations 
PageRank 
References 
6
0.73
30
Authors
3
Name
Order
Citations
PageRank
Sarah Zelikovitz118116.42
William W. Cohen2101781243.74
Haym Hirsh31839277.74