Hand Postures for Sonification Control

Hermann T, Nölker C, Ritter H (2002)
In: Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. Wachsmuth I, Sowa T (Eds);Berlin, Heidelberg: Springer: 307-316.

Conference Paper | Published | English

No fulltext has been uploaded

Author
Editor
Wachsmuth, Ipke ; Sowa, Timo
Abstract
Sonification is a rather new technique in human-computer interaction which addresses auditory perception. In contrast to speech interfaces, sonification uses non-verbal sounds to present information. The most common sonification technique is parameter mapping where for each data point a sonic event is generated whose acoustic attributes are determined from data values by a mapping function. For acoustic data exploration, this mapping must be adjusted or manipulated by the user. We propose the use of hand postures as a particularly natural and intuitive means of parameter manipulation for this data exploration task. As a demonstration prototype we developed a hand posture recognition system for gestural controlling of sound. The presented implementation applies artificial neural networks for the identification of continuous hand postures from camera images and uses a real-time sound synthesis engine. In this paper, we present our system and first applications of the gestural control of sounds. Techniques to apply gestures to control sonification are proposed and sound examples are given.
Keywords
Publishing Year
Conference
GW 2001
Location
London, UK
Conference Date
2001-04-18/2001-04-20
PUB-ID

Cite this

Hermann T, Nölker C, Ritter H. Hand Postures for Sonification Control. In: Wachsmuth I, Sowa T, eds. Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. Berlin, Heidelberg: Springer; 2002: 307-316.
Hermann, T., Nölker, C., & Ritter, H. (2002). Hand Postures for Sonification Control. In I. Wachsmuth & T. Sowa (Eds.), Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298 (pp. 307-316). Berlin, Heidelberg: Springer.
Hermann, T., Nölker, C., and Ritter, H. (2002). “Hand Postures for Sonification Control” in Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298, ed. I. Wachsmuth and T. Sowa (Berlin, Heidelberg: Springer), 307-316.
Hermann, T., Nölker, C., & Ritter, H., 2002. Hand Postures for Sonification Control. In I. Wachsmuth & T. Sowa, eds. Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. Berlin, Heidelberg: Springer, pp. 307-316.
T. Hermann, C. Nölker, and H. Ritter, “Hand Postures for Sonification Control”, Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298, I. Wachsmuth and T. Sowa, eds., Berlin, Heidelberg: Springer, 2002, pp.307-316.
Hermann, T., Nölker, C., Ritter, H.: Hand Postures for Sonification Control. In: Wachsmuth, I. and Sowa, T. (eds.) Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. p. 307-316. Springer, Berlin, Heidelberg (2002).
Hermann, Thomas, Nölker, Claudia, and Ritter, Helge. “Hand Postures for Sonification Control”. Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. Ed. Ipke Wachsmuth and Timo Sowa. Berlin, Heidelberg: Springer, 2002. 307-316.
This data publication is cited in the following publications:
This publication cites the following data publications:
2707114
Supplementary Material for "Hand Postures for Sonification Control"
Hermann T, Nölker C, Ritter H (2001)
Bielefeld University.

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar