Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification

Grond F, Hermann T (2012)
Journal on Multimodal User Interfaces 5(3-4): 87-95.

Journal Article | Published | English

No fulltext has been uploaded

Author
;
Abstract
We present in this paper SingingFunction, a vowel-based sonification strategy for mathematical functions. Within the research field of auditory graphs as representation of scalar functions, we focus in SingingFunction on important aspects of sound design, which allow to better distinguish function shapes as auditory gestalts. SingingFunction features the first vowel-based synthesis for function sonification, and allows for a seamless integration of higher derivatives of the function into a single sound stream. We present further the results of a psycho physical experiment, where we compare the effectiveness of function sonifications based on either mapping only f'(x), or including hirarchically further information about the first derivatives f'(x), or the second derivative f''(x). Further we look at interactivity as an important factor and report interesting effects across all 3 sonification methods by comparing interactive explorations versus simple playback of sonified functions. Finally, we discuss SingingFunction within the context of existing function sonifications, and possible evaluation methods.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Grond F, Hermann T. Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification. Journal on Multimodal User Interfaces. 2012;5(3-4):87-95.
Grond, F., & Hermann, T. (2012). Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification. Journal on Multimodal User Interfaces, 5(3-4), 87-95.
Grond, F., and Hermann, T. (2012). Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification. Journal on Multimodal User Interfaces 5, 87-95.
Grond, F., & Hermann, T., 2012. Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification. Journal on Multimodal User Interfaces, 5(3-4), p 87-95.
F. Grond and T. Hermann, “Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification”, Journal on Multimodal User Interfaces, vol. 5, 2012, pp. 87-95.
Grond, F., Hermann, T.: Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification. Journal on Multimodal User Interfaces. 5, 87-95 (2012).
Grond, Florian, and Hermann, Thomas. “Singing Function: Exploring Auditory Graphs with a Vowel Based Sonification”. Journal on Multimodal User Interfaces 5.3-4 (2012): 87-95.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar