Paper Info
Title
Evaluation of Personalised Information Retrieval at CLEF 2018 (PIR-CLEF).
Abstract
The series of Personalised Information Retrieval (PIR-CLEF) Labs at CLEF is intended as a forum for the exploration of methodologies for the repeatable evaluation of personalised information retrieval (PIR). The PIR-CLEF 2018 Lab is the first full edition of this series after the successful pilot edition at CLEF 2017, and provides a Lab task dedicated to personalised search, while the workshop at the conference will form the basis of further discussion of strategies for the evaluation of PIR and suggestions for improving the activities of the PIR-CLEF Lab. The PIR-CLEF 2018 Task is the first PIR evaluation benchmark based on the Cranfield paradigm, with the potential benefits of producing evaluation results that are easily reproducible. The task is based on search sessions over a subset of the ClueWeb12 collection, undertaken by volunteer searchers using a methodology developed in the CLEF 2017 pilot edition of PIR-CLEF. The PIR-CLEF test collection provides a detailed set of data gathered during the activities undertaken by each subject during the search sessions, including their search queries and details of relevant documents as marked by the searchers. The PIR-CLEF 2018 workshop is intended to review the design and construction of the collection, and to consider the topic of reproducible evaluation of PIR more generally with the aim of improving future editions of the evaluation benchmark.
Year
DOI
Venue
2018
10.1007/978-3-319-98932-7_29
Lecture Notes in Computer Science
Field
DocType
Volume
Information retrieval,Computer science,Clef
Conference
11018
ISSN
Citations 
PageRank 
0302-9743
1
0.36
References 
Authors
5
7
Name
Order
Citations
PageRank
Gabriella Pasi11673169.31
Gareth J. F. Jones22709300.77
Keith Curtis3155.50
Stefania Marrara417121.05
Camilla Sanvitto531.24
Debasis Ganguly621438.69
Procheta Sen735.29