Title
"Paint that object yellow" - Multimodal Interaction to Enhance Creativity During Design Tasks in VR.
Abstract
Virtual Reality (VR) has always been considered a promising medium to support designers with alternative work environments. Still, graphical user interfaces are prone to induce attention shifts between the user interface and the manipulated target objects which hampers the creative process. This work proposes a speech-and-gesture-based interaction paradigm for creative tasks in VR. We developed a multimodal toolbox (MTB) for VR-based design applications and compared it to a typical unimodal menu-based toolbox (UTB). The comparison uses a design-oriented use-case and measures flow, usability, and presence as relevant characteristics for a VR-based design process. The multimodal approach (1) led to a lower perceived task duration and a higher reported feeling of flow. It (2) provided a higher intuitive use and a lower mental workload while not being slower than an UTB. Finally, it (3) generated a higher feeling of presence. Overall, our results confirm significant advantages of the proposed multimodal interaction paradigm and the developed MTB for important characteristics of design processes in VR.
Year
DOI
Venue
2019
10.1145/3340555.3353724
ICMI
Keywords
Field
DocType
Speech and Gesture, Creativity, Design, 3D User Interfaces
Multimodal interaction,Computer science,Human–computer interaction,Creativity
Conference
ISBN
Citations 
PageRank 
978-1-4503-6860-5
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Erik Wolf112.71
Sara Klüber200.34
Chris Zimmerer3123.61
Jean-Luc Lugrin438338.87
Marc Erich Latoschik551576.83