Title
A CUP of CoFee: A large Collection of feedback Utterances Provided with communicative function annotations.
Abstract
There have been several attempts to annotate communicative functions to utterances of verbal feedback in English previously. Here, we suggest an annotation scheme for verbal and non-verbal feedback utterances in French including the categories base, attitude, previous and visual. The data comprises conversations, maptasks and negotiations from which we extracted ca. 13,000 candidate feedback utterances and gestures. 12 students were recruited for the annotation campaign of ca. 9,500 instances. Each instance was annotated by between 2 and 7 raters. The evaluation of the annotation agreement resulted in an average best-pair kappa of 0.6. While the base category with the values acknowledgement, evaluation, answer, elicit and other achieves good agreement, this is not the case for the other main categories. The data sets, which also include automatic extractions of lexical, positional and acoustic features, are freely available and will further be used for machine learning classification experiments to analyse the form-function relationship of feedback.
Year
Venue
Keywords
2016
LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION
Conversational Feedback,Communicative Functions,Annotator Agreement
Field
DocType
Citations 
Data set,Annotation,Gesture,Computer science,Speech recognition,Natural language processing,Artificial intelligence,Acknowledgement,Statistical classification
Conference
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Laurent Prévot16014.34
Jan Gorisch272.39
Roxane Bertrand34311.19