Paper Info
Title
Multimodal Effects of Color and Haptics on Intuitive Interaction with Tangible User Interfaces.
Abstract
Tangible User Interfaces (TUIs) allow users to sense and manipulate digital information through physical objects. Although haptic properties are emphasized, TUIs are presented in and perceived through multiple modalities. Especially visual properties like color shape the users expectations about the relation between tangibles and the abstract data they represent and control. Viewing TUIs as multisensory percepts, we present an empirical study that quantifies benefits of an explicit design for color for intuitive interaction. In a cross-cultural experiment, 75 participants (Germans and Japanese) matched tangible objects of different colors, sizes, weights or temperatures with abstract words. The results indicate that multimodal representations increase the efficiency, effectiveness and user satisfaction, but only if colors and haptic properties evoke congruent associations. Incongruently designed tangibles led to a 17% increase in response speed, -28% lower accuracy and -61% lower preference ratings compared to congruently designed tangibles.
Year
DOI
Venue
2018
10.1145/3173225.3173257
TEI '18: Twelfth International Conference on Tangible, Embedded, and Embodied Interaction Stockholm Sweden March, 2018
Keywords
Field
DocType
Colors, embodied cognition, conceptual metaphor theory, image schemas, tangible user interfaces, intuitive interaction, design guidelines, multimodal interaction, cross-modal interaction
Multimodal interaction,Computer science,Multiple modalities,Embodied cognition,Human–computer interaction,If and only if,User interface,Multimedia,Congruence (geometry),Haptic technology,Empirical research
Conference
ISBN
Citations 
PageRank 
978-1-4503-5568-1
0
0.34
References 
Authors
8
3
Name
Order
Citations
PageRank
Diana Löffler1269.71
Robert Tscharn2132.69
Jörn Hurtienne326844.65