Title
Curve shape and curvature perception through interactive sonification
Abstract
In this article we present an approach that uses sound to communicate geometrical data related to a virtual object. This has been developed in the framework of a multimodal interface for product design. The interface allows a designer to evaluate the quality of a 3-D shape using touch, vision, and sound. Two important considerations addressed in this article are the nature of the data that is sonified and the haptic interaction between the user and the interface, which in fact triggers the sound and influences its characteristics. Based on these considerations, we present a number of sonification strategies that are designed to map the geometrical data of interest into sound. The fundamental frequency of various sounds was used to convey the curve shape or the curvature to the listeners. Two evaluation experiments are described, one involves partipants with a varied background, the other involved the intended users, i.e. participants with a background in industrial design. The results show that independent of the sonification method used and independent of whether the curve shape or the curvature were sonified, the sonification was quite successful. In the first experiment participants had a success rate of about 80% in a multiple choice task, in the second experiment it took the participants on average less than 20 seconds to find the maximum, minimum or inflection points of the curvature of a test curve.
Year
DOI
Venue
2012
10.1145/2355598.2355600
TAP
Keywords
Field
DocType
sonification method,test curve,multimodal interface,curve shape,interactive sonification,curvature perception,sonification strategy,experiment participant,evaluation experiment,various sound,3-d shape,geometrical data,haptics,sonification
Virtual image,Industrial design,Computer vision,Inflection point,Curvature,Computer science,Sonification,Human–computer interaction,Artificial intelligence,Product design,Perception,Haptic technology
Journal
Volume
Issue
ISSN
9
4
1544-3558
Citations 
PageRank 
References 
9
0.92
16
Authors
7
Name
Order
Citations
PageRank
Miguel A. Alonso130138.42
Simon Shelley2141.52
Dik J. Hermes36810.95
Jacqueline Hollowood4141.52
Michael Pettitt5263.26
Sarah C. Sharples623620.39
Armin Kohlrausch722719.66