Title
Decoding multi-click search behavior based on marginal utility.
Abstract
Query logs contain rich feedback information from users interacting with search engines. Therefore, various click models have been developed to interpret users' search behavior and to extract useful knowledge from query logs. However, most existing models are not designed to consider novelty bias in click behavior. The underlying hypothesis behind this paper is that given the previously clicked documents, a user tends to choose documents which provide novel relevant information to satisfy her information need, rather than redundant relevant information. Moreover, the prior click models have been mainly tested on frequently occurring queries, hence, leaving a large proportion of sparse queries uncovered. In this paper, we propose to predict users' click behavior from the perspective of utility theory (i.e., utility and marginal utility). In particular, as a complement to the examination hypothesis, we introduce a new hypothesis called marginal utility hypothesis to characterize the effect of novelty bias on users' click behavior by exploring the semantic divergence among documents in a result list. Moreover, to cope with sparse or unseen queries that have not been observed in the training set, we use a set of descriptive features to quantify the probability of a document being relevant and probability of a document providing marginally (novel) useful information. Finally, a series of experiments are conducted on a real-world data set to validate the effectiveness of the proposed methods. The experimental results verify the effectiveness of interpreting users' click behavior based on the marginal utility hypothesis, especially when query sessions contain sparse queries or unseen query-document pairs.
Year
DOI
Venue
2017
10.1007/s10791-016-9289-z
Inf. Retr. Journal
Keywords
Field
DocType
Click model, Query session, Novelty bias, Marginal utility
Data mining,Computer science,Artificial intelligence,Marginal utility,Click model,Training set,Search engine,Information needs,Information retrieval,Decoding methods,Novelty,Machine learning,Utility theory
Journal
Volume
Issue
ISSN
20
1
1573-7659
Citations 
PageRank 
References 
2
0.37
46
Authors
5
Name
Order
Citations
PageRank
Yu Haitao1178.10
Adam Jatowt2903106.73
Roi Blanco387257.42
Hideo Joho488170.47
Joemon M. Jose52782198.37