Paper Info
Title
The CHIL audiovisual corpus for lecture and meeting analysis inside smart rooms.
Abstract
The analysis of lectures and meetings inside smart rooms has recently attracted much interest in the literature, being the focus of international projects and technology evaluations. A key enabler for progress in this area is the availability of appropriate multimodal and multi-sensory corpora, annotated with rich human activity information during lectures and meetings. This paper is devoted to exactly such a corpus, developed in the framework of the European project CHIL, “Computers in the Human Interaction Loop”. The resulting data set has the potential to drastically advance the state-of-the-art, by providing numerous synchronized audio and video streams of real lectures and meetings, captured in multiple recording sites over the past 4 years. It particularly overcomes typical shortcomings of other existing databases that may contain limited sensory or monomodal data, exhibit constrained human behavior and interaction patterns, or lack data variability. The CHIL corpus is accompanied by rich manual annotations of both its audio and visual modalities. These provide a detailed multi-channel verbatim orthographic transcription that includes speaker turns and identities, acoustic condition information, and named entities, as well as video labels in multiple camera views that provide multi-person 3D head and 2D facial feature location information. Over the past 3 years, the corpus has been crucial to the evaluation of a multitude of audiovisual perception technologies for human activity analysis in lecture and meeting scenarios, demonstrating its utility during internal evaluations of the CHIL consortium, as well as at the recent international CLEAR and Rich Transcription evaluations. The CHIL corpus is publicly available to the research community.
Year
DOI
Venue
2007
10.1007/s10579-007-9054-4
Language Resources and Evaluation
Keywords
DocType
Volume
Mutlimodal,Corpus,Annotation,Evaluation,Audio,Video
Journal
41
Issue
ISSN
Citations 
3-4
1572-8412
35
PageRank 
References 
Authors
1.60
3
17
Name
Order
Citations
PageRank
Djamel Mostefa135935.40
Nicolas Moreau21478.65
Khalid Choukri31100153.56
Gerasimos Potamianos41113113.80
Stephen M. Chu537226.33
Ambrish Tyagi621012.63
Josep R. Casas721223.34
Jordi Turmo830630.52
Luca Cristoforetti91177.35
Francesco Tobia10553.30
Aristodemos Pnevmatikakis1122627.09
Vasileios Mylonakis12392.76
Fotios Talantzis13656.22
Susanne Burger1425440.52
Rainer Stiefelhagen153512274.86
Keni Bernardin1676432.03
Cedrick Rochet17351.60