Title
Analysis of varying approaches to topical web query classification.
Abstract
Topical classification of web queries has drawn recent interest from forums such as the 2005 KDD Cup because of the promise it offers in improving retrieval effectiveness and efficiency. Many proposed techniques make use of documents classified in taxonomies (such as the ODP: Open Directory Project -- http://www.dmoz.org) to inform on the class of a web query. Implicit in these approaches is the assumption that topically classifying queries is equivalent to the general topical text classification task (although with few directly available features from such short queries). We test this assumption by comparing and combining classifiers trained directly from manually classified queries and their retrieved documents, trained from categorized documents in the ODP, and induced from unlabeled query logs for pre-retrieval classification. We find that training classifiers directly from manually classified queries outperforms the best general topical classifier by 48% in relative F1 score. We attribute this to a mismatch in task when applying a general classifier to queries. For example, a typically vague web query classified as "business" is likely to retrieve documents classified as "news" and "organizations" in addition to those labeled "business." Equating a "business" class of queries with a "business" class of documents, then, is not appropriate.
Year
Venue
Keywords
2008
Infoscale
general classifier,web query classification,topically classifying query,unlabeled query log,short query,general topical classifier,web query,varying approach,pre-retrieval classification,classified query,topical classification,general topical text classification
Field
DocType
Citations 
Web search query,F1 score,Equating,Information retrieval,Computer science,Directory,Web query classification,Classifier (linguistics)
Conference
2
PageRank 
References 
Authors
0.37
16
4
Name
Order
Citations
PageRank
Steven M. Beitzel169646.72
Eric C. Jensen269646.72
Abdur Chowdhury32013160.59
Ophir Frieder43300419.55