Title
Mining subtopics from different aspects for diversifying search results
Abstract
User queries to the Web tend to have more than one interpretation due to their ambiguity and other characteristics. How to diversify the ranking results to meet users' various potential information needs has attracted considerable attention recently. This paper is aimed at mining the subtopics of a query either indirectly from the returned results of retrieval systems or directly from the query itself to diversify the search results. For the indirect subtopic mining approach, clustering the retrieval results and summarizing the content of clusters is investigated. In addition, labeling topic categories and concept tags on each returned document is explored. For the direct subtopic mining approach, several external resources, such as Wikipedia, Open Directory Project, search query logs, and the related search services of search engines, are consulted. Furthermore, we propose a diversified retrieval model to rank documents with respect to the mined subtopics for balancing relevance and diversity. Experiments are conducted on the ClueWeb09 dataset with the topics of the TREC09 and TREC10 Web Track diversity tasks. Experimental results show that the proposed subtopic-based diversification algorithm significantly outperforms the state-of-the-art models in the TREC09 and TREC10 Web Track diversity tasks. The best performance our proposed algorithm achieves is 驴-nDCG@5 0.307, IA-P@5 0.121, and 驴#-nDCG@5 0.214 on the TREC09, as well as 驴-nDCG@10 0.421, IA-P@10 0.201, and 驴#-nDCG@10 0.311 on the TREC10. The results conclude that the subtopic mining technique with the up-to-date users' search query logs is the most effective way to generate the subtopics of a query, and the proposed subtopic-based diversification algorithm can select the documents covering various subtopics.
Year
DOI
Venue
2013
10.1007/s10791-012-9215-y
Inf. Retr.
Keywords
Field
DocType
mining subtopics,different aspect,proposed subtopic-based diversification algorithm,trec10 web track diversity,indirect subtopic mining approach,query log,user query,search engine,direct subtopic mining approach,mined subtopics,search result,related search service
Data mining,Web search query,Information needs,Search engine,Information retrieval,Ranking,Query expansion,Computer science,Web query classification,Ranking (information retrieval),Cluster analysis
Journal
Volume
Issue
ISSN
16
4
1573-7659
Citations 
PageRank 
References 
5
0.50
39
Authors
4
Name
Order
Citations
PageRank
Chieh-Jen Wang164825.08
Yung-Wei Lin281.29
Ming-Feng Tsai3102445.13
Hsin-hsi Chen42267233.93