Title
Similarity model and term association for document categorization
Abstract
Both Euclidean distance- and cosine-based similarity models are widely used for measures of document similarity in information retrieval and document categorization. These two similarity models are based on the assumption that term vectors are orthogonal. But this assumption is not true. Term associations are ignored in such similarity models. In the document categorization context, we analyze the properties of term-document space, term-category space and category-document space. Then, without the assumption of term independence, we propose a new mathematical model to estimate the association between terms and define an ε-similarity model of documents. Here we make best use of existing category membership represented by the corpus as much as possible, and the objective is to improve categorization performance. Experiments have been done with a k-NN classifier over the Reuters-5178 corpus. The empirical results show that utilization of term association can improve the effectiveness of the categorization system and the ε-similarity model outperforms those without term association.
Year
DOI
Venue
2002
10.1109/DEXA.2002.1045908
NLDB
Keywords
DocType
Volume
information retrieval,mathematical model,euclidean distance
Conference
2553
ISSN
ISBN
Citations 
1529-4188
0-7695-1668-8
8
PageRank 
References 
Authors
0.66
8
2
Name
Order
Citations
PageRank
Huaizhong Kou1152.60
G. Gardarin2900710.49