Title
The “FAME” interactive space
Abstract
This paper describes the “FAME” multi-modal demonstrator, which integrates multiple communication modes – vision, speech and object manipulation – by combining the physical and virtual worlds to provide support for multi-cultural or multi-lingual communication and problem solving. The major challenges are automatic perception of human actions and understanding of dialogs between people from different cultural or linguistic backgrounds. The system acts as an information butler, which demonstrates context awareness using computer vision, speech and dialog modeling. The integrated computer-enhanced human-to-human communication has been publicly demonstrated at the FORUM2004 in Barcelona and at IST2004 in The Hague. Specifically, the “Interactive Space” described features an “Augmented Table” for multi-cultural interaction, which allows several users at the same time to perform multi-modal, cross-lingual document retrieval of audio-visual documents previously recorded by an “Intelligent Cameraman” during a week-long seminar.
Year
DOI
Venue
2005
10.1007/11677482_11
MLMI
Keywords
Field
DocType
audio-visual document,integrated computer-enhanced human-to-human communication,computer vision,multiple communication mode,multi-lingual communication,augmented table,intelligent cameraman,multi-cultural interaction,interactive space,multi-modal demonstrator
Dialog box,Metaverse,Computer science,Word error rate,Context awareness,Artificial intelligence,Document retrieval,Multimedia,Perception,Machine learning
Conference
Volume
ISSN
ISBN
3869
0302-9743
3-540-32549-2
Citations 
PageRank 
References 
6
0.50
10
Authors
17
Name
Order
Citations
PageRank
Florian Metze11069106.49
P. Gieselmann2602.92
H. Holzapfel360.50
T. Kluge460.50
I. Rogina58815.47
Alex Waibel663431980.68
M. Wölfel7191.67
J. Crowley860.50
P. Reignier9463.25
D. Vaufreydaz10254.40
F. Bérard1160.50
B. Cohen1260.50
J. Coutaz13396.23
S. Rouillard1460.84
V. Arranz1560.50
M. Bertrán1660.50
H. Rodriguez1760.50