Name
Title | ||
|---|---|---|
Haptic feedback combined with movement sonification using a friction sound improves task performance in a virtual throwing task |
Abstract | ||
|---|---|---|
In this paper we present a study on the effects of auditory- and haptic feedback in a virtual throwing task performed with a point-based haptic device. The main research objective was to investigate if and how task performance and perceived intuitiveness is affected when interactive sonification and/or haptic feedback is used to provide real-time feedback about a movement performed in a 3D virtual environment. Emphasis was put on task solving efficiency and subjective accounts of participants’ experiences of the multimodal interaction in different conditions. The experiment used a within-subjects design in which the participants solved the same task in different conditions: visual-only, visuohaptic, audiovisual and audiovisuohaptic. Two different sound models were implemented and compared. Significantly lower error rates were obtained in the audiovisuohaptic condition involving movement sonification based on a physical model of friction, compared to the visual-only condition. Moreover, a significant increase in perceived intuitiveness was observed for most conditions involving haptic and/or auditory feedback, compared to the visual-only condition. The main finding of this study is that multimodal feedback can not only improve perceived intuitiveness of an interface but that certain combinations of haptic feedback and movement sonification can also contribute with performance-enhancing properties. This highlights the importance of carefully designing feedback combinations for interactive applications. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1007/s12193-018-0264-4 | Journal on Multimodal User Interfaces |
Keywords | Field | DocType |
Sonification, Haptic feedback, Multimodal interaction, Task performance | Multimodal interaction,Signal processing,Computer science,Throwing,Sonification,Human–computer interaction,Haptic technology | Journal |
Volume | Issue | ISSN |
13 | 4 | 1783-8738 |
Citations | PageRank | References |
0 | 0.34 | 18 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Emma Frid | 1 | 1 | 2.75 |
| Jonas Moll | 2 | 48 | 5.59 |
| roberto bresin | 3 | 268 | 39.63 |
| Eva-Lotta Sallnäs Pysander | 4 | 12 | 2.95 |