Abstract | ||
---|---|---|
In this study, we seek to understand how providing feedback to users about their performances with an interactive information retrieval (IIR) system impacts their evaluations of that system. Sixty subjects completed three recall-based searching tasks with an experimental IIR system and were asked to evaluate the system after each task and after finishing all three tasks. Before completing the final evaluation, three-fourths of the subjects were provided with feedback about their performances. Subjects were assigned randomly to one of four feedback conditions: a baseline condition where no feedback was provided; an actual feedback condition where subjects were provided with their real performances; and two conditions where subjects were deceived and told that they performed very well or very poorly. Results show that the type of feedback provided significantly affected subjects' system evaluations; most importantly there was a significant difference in subjects' satisfaction ratings before and after feedback was provided in the actual feedback condition. |
Year | DOI | Venue |
---|---|---|
2008 | 10.1145/1414694.1414712 | IIiX |
Keywords | Field | DocType |
significant difference,final evaluation,baseline condition,actual feedback condition,feedback condition,interactive information retrieval,system evaluation,real performance,satisfaction rating,performance feedback,interactive ir system,experimental iir system,relevance,communication,meaning | Music information retrieval,Information retrieval,Computer science,Recall,Performance feedback | Conference |
Citations | PageRank | References |
5 | 0.47 | 15 |
Authors | ||
13 |
Name | Order | Citations | PageRank |
---|---|---|---|
Diane Kelly | 1 | 1711 | 104.63 |
Chirag Shah | 2 | 1065 | 85.87 |
Cassidy R. Sugimoto | 3 | 976 | 60.53 |
Earl W. Bailey | 4 | 85 | 3.58 |
Rachael A. Clemens | 5 | 5 | 0.47 |
Ann Irvine | 6 | 219 | 15.23 |
Nicholas A. Johnson | 7 | 5 | 0.47 |
Weimao Ke | 8 | 296 | 23.27 |
Sanghee Oh | 9 | 382 | 23.28 |
Anezka Poljakova | 10 | 5 | 0.47 |
Marcos A. Rodriguez | 11 | 5 | 0.47 |
Megan G. van Noord | 12 | 5 | 0.47 |
Yan Zhang | 13 | 265 | 15.44 |