Title
A large-scale evaluation and analysis of personalized search strategies
Abstract
Although personalized search has been proposed for many years and many personalization strategies have been investigated, it is still unclear whether personalization is consistently effective on different queries for different users, and under different search contexts. In this paper, we study this problem and get some preliminary conclusions. We present a large-scale evaluation framework for personalized search based on query logs, and then evaluate five personalized search strategies (including two click-based and three profile-based ones) using 12-day MSN query logs. By analyzing the results, we reveal that personalized search has significant improvement over common web search on some queries but it also has little effect on other queries (e.g., queries with small click entropy). It even harms search accuracy under some situations. Furthermore, we show that straightforward click-based personalization strategies perform consistently and considerably well, while profile-based ones are unstable in our experiments. We also reveal that both long-term and short-term contexts are very important in improving search performance for profile-based personalized search strategies.
Year
DOI
Venue
2007
10.1145/1242572.1242651
WWW
Keywords
DocType
Citations 
personalized search strategy,different search context,search accuracy,common web search,different user,search performance,large-scale evaluation,personalization strategy,personalized search,different query,profile-based personalized search strategy,personalization,click through
Conference
251
PageRank 
References 
Authors
8.19
30
3
Search Limit
100251
Name
Order
Citations
PageRank
Zhicheng Dou170641.96
Ruihua Song2113859.33
Ji-Rong Wen34431265.98