Paper Info
Title
Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?
Abstract
The main aspects of XML retrieval are identie d by analysing and comparing the following two behaviours: the behaviour of the assessor when judging the relevance of returned doc- ument components; and the behaviour of users when inter- acting with components of XML documents. We argue that the two INEX relevance dimensions, Exhaustivity and Speci- city, are not orthogonal dimensions; indeed, an empirical analysis of each dimension reveals that the grades of the two dimensions are correlated to each other. By analysing the level of agreement between the assessor and the users, we aim at identifying the best units of retrieval. The results of our analysis show that the highest level of agreement is on highly relevant and on non-relevant document components, suggesting that only the end points of the INEX 10-point relevance scale are perceived in the same way by both the assessor and the users. We propose a new denition of rel- evance for XML retrieval and argue that its corresponding relevance scale would be a better choice for INEX.
Year
Venue
Keywords
2005
Clinical Orthopaedics and Related Research
two dimensions,xml document,information retrieval
Field
DocType
Volume
Data mining,Information retrieval,XML,Computer science,XML retrieval
Journal
abs/cs/050
ISSN
Citations 
PageRank 
Pehcevski J., Thom J., Vercoustre A.-M. "Users and Assessors in the Context of INEX: Are Relevance Dimensions Relevant?" Dans INEX 2005 Workshop on Element Retrieval Methodology [OAI : oai:hal.inria.fr:inria-00000182\_v1] - http://hal.inria.fr/inria-00000182
7
1.05
References 
Authors
15
3
Name
Order
Citations
PageRank
Jovan Pehcevski119913.72
James A. Thom2622182.05
Anne-Marie Vercoustre333181.83