Abstract | ||
---|---|---|
This paper outlines first the BET method for task-based evaluation of meeting browsers. 'Observations of interest' in meetings are empirically determined by neutral observers and then processed and ordered by evaluators. The evaluation of the TQB annotation-driven meeting browser using the BET is then described. A series of subjects attempted to answer as many meeting-related questions as possible in a fixed amount of time, and their performance was measured in terms of precision and speed. The results indicate that the TQB interface is easy to understand with little prior learning and that its annotation-based search functionality is highly relevant, in particular keyword search over the meeting transcript. Two knowledge-poorer browsers appear to offer lower precision but higher speed. The BET task-based evaluation method thus appears to be a coherent measure of browser quality. |
Year | DOI | Venue |
---|---|---|
2007 | 10.1007/978-3-540-78155-4_10 | MLMI |
Keywords | Field | DocType |
bet method,higher speed,browser quality,bet task-based evaluation method,task-based evaluation,annotation-based search functionality,meeting transcript,tqb annotation-driven meeting browser,objective test,bet4tqb pilot experiment,tqb interface,meeting browser,human factors,human computer interaction | Annotation,Information retrieval,Computer science,Keyword search,Objective test,Pilot experiment | Conference |
Volume | ISSN | ISBN |
4892 | 0302-9743 | 3-540-78154-4 |
Citations | PageRank | References |
3 | 0.43 | 9 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Andrei Popescu-Belis | 1 | 573 | 64.13 |
Philippe Baudrion | 2 | 3 | 0.43 |
Mike Flynn | 3 | 272 | 14.75 |
Pierre Wellner | 4 | 568 | 182.61 |