Title
Designing and evaluating multimodal interaction for mobile contexts
Abstract
In this paper we report on our experience on the design and evaluation of multimodal user interfaces in various contexts. We introduce a novel combination of existing design and evaluation methods in the form of a 5-step iterative process and show the feasibility of this method and some of the lessons learned through the design of a messaging application for two contexts (in car, walking). The iterative design process we employed included the following five basic steps: 1) identification of the limitations affecting the usage of different modalities in various contexts (contextual observations and context analysis) 2) identifying and selecting suitable interaction concepts and creating a general design for the multimodal application (storyboarding, use cases, interaction concepts, task breakdown, application UI and interaction design), 3) creating modality-specific UI designs, 4) rapid prototyping and 5) evaluating the prototype in naturalistic situations to find key issues to be taken into account in the next iteration. We have not only found clear indications that context affects users' preferences in the usage of modalities and interaction strategies but also identified some of these. For instance, while speech interaction was preferred in the car environment users did not consider it useful when they were walking. 2D (finger strokes) and especially 3D (tilt) gestures were preferred by walking users.
Year
DOI
Venue
2008
10.1145/1452392.1452447
ICMI
Keywords
Field
DocType
application ui,iterative design process,interaction design,modality-specific ui design,multimodal interaction,suitable interaction concept,interaction concept,mobile context,speech interaction,interaction strategy,general design,various context,iterative design,design,human factors,human computer interaction,theory,evaluation,use case
Pluralistic walkthrough,Multimodal interaction,Use case,Interaction design,Iterative and incremental development,Gesture,Computer science,Human–computer interaction,Iterative design,User interface,Multimedia
Conference
Citations 
PageRank 
References 
18
0.73
21
Authors
4
Name
Order
Citations
PageRank
Saija Lemmelä1272.35
Akos Vetek2978.44
Kaj Mäkelä3704.58
Dari Trendafilov4253.63