Title
Using statistical testing in the evaluation of retrieval experiments
Abstract
The standard strategies for evaluation based on precision and recall are examined and their relative advantages and disadvantages are discussed. In particular, it is suggested that relevance feedback be evaluated from the perspective of the user. A number of different statistical tests are described for determining if differences in performance between retrieval methods are significant. These tests have often been ignored in the past because most are based on an assumption of normality which is not strictly valid for the standard performance measures. However, one can test this assumption using simple diagnostic plots, and if it is a poor approximation, there are a number of non-parametric alternatives.
Year
DOI
Venue
1993
10.1145/160688.160758
SIGIR
Keywords
Field
DocType
hypertext,graph theory,structural analysis,aggregation,statistical test,clustering
Graph theory,Normality,Hypertext,Data mining,Relevance feedback,Computer science,Precision and recall,Cluster analysis,Statistical hypothesis testing
Conference
ISBN
Citations 
PageRank 
0-89791-605-0
251
38.23
References 
Authors
8
1
Search Limit
100251
Name
Order
Citations
PageRank
David A. Hull11282214.27