Paper Info
Title
A framework for the intelligent multimodal presentation of information
Abstract
Intelligent multimodal presentation of information aims at using several communication modalities to produce the most relevant user outputs. This problem involves different concepts related to information structure, interaction components (modes, modalities, devices) and context. In this paper we study the influence of interaction context on system outputs. More precisely, we propose a conceptual model for intelligent multimodal presentation of information. This model, called WWHT, is based on four concepts: "What", "Which", "How" and "Then". These concepts describe the life cycle of a multimodal presentation from its "birth" to its "death" including its evolution. On the basis of this model, we present the ELOQUENCE software platform for the specification, the simulation and the execution of output multimodal systems. Finally, we describe two applications of this framework: the first one concerns the simulation of an incoming call in an intelligent mobile phone and the second one is related to a task of marking out a target on the ground in a fighter plane cockpit.
Year
DOI
Venue
2006
10.1016/j.sigpro.2006.02.041
Signal Processing
Keywords
Field
DocType
intelligent mobile phone,output multimodal system,interaction component,conceptual model,information structure,interaction context,intelligent multimodal presentation,eloquence software platform,communication modality,multimodal presentation,life cycle,human computer interaction
Information structure,Modalities,Mathematical optimization,Conceptual model,Software,Mode coupling,Human–computer interaction,Cockpit,Artificial intelligence,Mobile phone,Engineering,User interface
Journal
Volume
Issue
ISSN
86
12
Signal Processing
Citations 
PageRank 
References 
29
1.62
24
Authors
4
Name
Order
Citations
PageRank
Cyril Rousseau1463.30
Yacine Bellik213220.30
Frédéric Vernier354444.54
Didier Bazalgette4291.96