Title
Finally on Par?! Multimodal and Unimodal Interaction for Open Creative Design Tasks in Virtual Reality
Abstract
Multimodal Interfaces (MMIs) have been considered to provide promising interaction paradigms for Virtual Reality (VR) for some time. However, they are still far less common than unimodal interfaces (UMIs). This paper presents a summative user study comparing an MMI to a typical UMI for a design task in VR. We developed an application targeting creative 3D object manipulations, i.e., creating 3D objects and modifying typical object properties such as color or size. The associated open user task is based on the Torrence Tests of Creative Thinking. We compared a synergistic multimodal interface using speech-accompanied pointing/grabbing gestures with a more typical unimodal interface using a hierarchical radial menu to trigger actions on selected objects. Independent judges rated the creativity of the resulting products using the Consensual Assessment Technique. Additionally, we measured the creativity-promoting factors flow, usability, and presence. Our results show that the MMI performs on par with the UMI in all measurements despite its limited flexibility and reliability. These promising results demonstrate the technological maturity of MMIs and their potential to extend traditional interaction techniques in VR efficiently.
Year
DOI
Venue
2020
10.1145/3382507.3418850
ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION Virtual Event Netherlands October, 2020
DocType
ISBN
Citations 
Conference
978-1-4503-7581-8
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Chris Zimmerer1123.61
Erik Wolf212.71
Sara Wolf300.34
Martin Fischbach4357.98
Jean-Luc Lugrin538338.87
Marc Erich Latoschik651576.83