Title
Towards an objective test for meeting browsers: the BET4TQB pilot experiment
Abstract
This paper outlines first the BET method for task-based evaluation of meeting browsers. 'Observations of interest' in meetings are empirically determined by neutral observers and then processed and ordered by evaluators. The evaluation of the TQB annotation-driven meeting browser using the BET is then described. A series of subjects attempted to answer as many meeting-related questions as possible in a fixed amount of time, and their performance was measured in terms of precision and speed. The results indicate that the TQB interface is easy to understand with little prior learning and that its annotation-based search functionality is highly relevant, in particular keyword search over the meeting transcript. Two knowledge-poorer browsers appear to offer lower precision but higher speed. The BET task-based evaluation method thus appears to be a coherent measure of browser quality.
Year
DOI
Venue
2007
10.1007/978-3-540-78155-4_10
MLMI
Keywords
Field
DocType
bet method,higher speed,browser quality,bet task-based evaluation method,task-based evaluation,annotation-based search functionality,meeting transcript,tqb annotation-driven meeting browser,objective test,bet4tqb pilot experiment,tqb interface,meeting browser,human factors,human computer interaction
Annotation,Information retrieval,Computer science,Keyword search,Objective test,Pilot experiment
Conference
Volume
ISSN
ISBN
4892
0302-9743
3-540-78154-4
Citations 
PageRank 
References 
3
0.43
9
Authors
4
Name
Order
Citations
PageRank
Andrei Popescu-Belis157364.13
Philippe Baudrion230.43
Mike Flynn327214.75
Pierre Wellner4568182.61