Title
Report on the First International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol'2015).
Abstract
The workshop on the evaluation of collaborative information retrieval and seeking (ECol) was held in conjunction with the 24th Conference on Information and Knowledge Management (CIKM) in Melbourne, Australia. The workshop featured three main elements. First, a keynote on the main dimensions, challenges, and opportunities in collaborative information retrieval and seeking by Chirag Shah. Second, an oral presentation session in which four papers were presented. Third, a discussion based on three seed research questions: (1) In what ways is collaborative search evaluation more challenging than individual interactive information retrieval (IIIR) evaluation? (2) Would it be possible and/or useful to standardise experimental designs and data for collaborative search evaluation? and (3) For evaluating collaborative search, can we leverage ideas from other tasks such as diversified search, subtopic mining and/or e-discovery? The discussion was intense and raised many points and issues, leading to the proposition that a new evaluation track focused on collaborative information retrieval/seeking tasks, would be worthwhile.
Year
DOI
Venue
2016
10.1145/2964797.2964805
SIGIR Forum
Field
DocType
Volume
Data mining,World Wide Web,Proposition,Human–computer information retrieval,Information retrieval,Computer science,Collaborative information seeking,Information seeking
Journal
50
Issue
Citations 
PageRank 
1
2
0.37
References 
Authors
18
5
Name
Order
Citations
PageRank
Laure Soulier19417.67
Lynda Tamine251452.91
Tetsuya Sakai31460139.97
Leif Azzopardi41919133.10
Jeremy Pickens544137.14