Title
When Is The Probability Ranking Principle Suboptimal
Abstract
The probability ranking principle retrieves documents in decreasing order of their predictive probabilities of relevance. Gordon and Lenk (1991) demonstrated that this principal is optimal within a signal detection-decision theory framework, and it maximizes the inquirer's expected utility for relevant documents. These results hold under three conditions: calibration, independent assessment of relevance by the inquirer, and certainty about the computed probabilities of relevance. We demonstrate that the probability ranking principle can be suboptimal with respect to expected utility when one of these conditions fails to hold.
Year
DOI
Venue
1992
10.1002/(SICI)1097-4571(199201)43:1<1::AID-ASI1>3.0.CO;2-5
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE
Keywords
Field
DocType
information retrieval,mathematical formulas,probability,relevance information retrieval
Data mining,Certainty,Information retrieval,Ranking,Computer science,Expected utility hypothesis,Decision theory,Relevance (information retrieval),Statistical model,Document retrieval
Journal
Volume
Issue
ISSN
43
1
0002-8231
Citations 
PageRank 
References 
14
1.24
0
Authors
2
Name
Order
Citations
PageRank
Michael D. Gordon1105199.36
Peter Lenk2141.24