Abstract | ||
---|---|---|
This paper describes the “FAME” multi-modal demonstrator, which integrates multiple communication modes – vision, speech and object manipulation – by combining the physical and virtual worlds to provide support for multi-cultural or multi-lingual communication and problem solving. The major challenges are automatic perception of human actions and understanding of dialogs between people from different cultural or linguistic backgrounds. The system acts as an information butler, which demonstrates context awareness using computer vision, speech and dialog modeling. The integrated computer-enhanced human-to-human communication has been publicly demonstrated at the FORUM2004 in Barcelona and at IST2004 in The Hague. Specifically, the “Interactive Space” described features an “Augmented Table” for multi-cultural interaction, which allows several users at the same time to perform multi-modal, cross-lingual document retrieval of audio-visual documents previously recorded by an “Intelligent Cameraman” during a week-long seminar. |
Year | DOI | Venue |
---|---|---|
2005 | 10.1007/11677482_11 | MLMI |
Keywords | Field | DocType |
audio-visual document,integrated computer-enhanced human-to-human communication,computer vision,multiple communication mode,multi-lingual communication,augmented table,intelligent cameraman,multi-cultural interaction,interactive space,multi-modal demonstrator | Dialog box,Metaverse,Computer science,Word error rate,Context awareness,Artificial intelligence,Document retrieval,Multimedia,Perception,Machine learning | Conference |
Volume | ISSN | ISBN |
3869 | 0302-9743 | 3-540-32549-2 |
Citations | PageRank | References |
6 | 0.50 | 10 |
Authors | ||
17 |
Name | Order | Citations | PageRank |
---|---|---|---|
Florian Metze | 1 | 1069 | 106.49 |
P. Gieselmann | 2 | 60 | 2.92 |
H. Holzapfel | 3 | 6 | 0.50 |
T. Kluge | 4 | 6 | 0.50 |
I. Rogina | 5 | 88 | 15.47 |
Alex Waibel | 6 | 6343 | 1980.68 |
M. Wölfel | 7 | 19 | 1.67 |
J. Crowley | 8 | 6 | 0.50 |
P. Reignier | 9 | 46 | 3.25 |
D. Vaufreydaz | 10 | 25 | 4.40 |
F. Bérard | 11 | 6 | 0.50 |
B. Cohen | 12 | 6 | 0.50 |
J. Coutaz | 13 | 39 | 6.23 |
S. Rouillard | 14 | 6 | 0.84 |
V. Arranz | 15 | 6 | 0.50 |
M. Bertrán | 16 | 6 | 0.50 |
H. Rodriguez | 17 | 6 | 0.50 |