Supplementary Material for "Hand Postures for Sonification Control"

Hermann T, Nölker C, Ritter H (2001)
Bielefeld University.

Datenpublikation
 
Download
OA
OA S2: Hand postures for articulated voice control
OA S3.1: Interactive sonification of parameter mappings
Alle
Creator
Abstract / Bemerkung
Sonification is a rather new technique in human-computer interaction which addresses auditory perception. In contrast to speech interfaces, sonification uses non-verbal sounds to present information. The most common sonification technique is parameter mapping where for each data point a sonic event is generated whose acoustic attributes are determined from data values by a mapping function. For acoustic data exploration, this mapping must be adjusted or manipulated by the user. We propose the use of hand postures as a particularly natural and intuitive means of parameter manipulation for this data exploration task. As a demonstration prototype we developed a hand posture recognition system for gestural controlling of sound. The presented implementation applies artificial neural networks for the identification of continuous hand postures from camera images and uses a real-time sound synthesis engine. In this paper, we present our system and first applications of the gestural control of sounds. Techniques to apply gestures to control sonification are proposed and sound examples are given. #### S1: Handposture-driven soundscape control This example is a real-time synthesis of a “soundscape” which has a relaxing effect and can be thought of as playing a simple instrument just by moving the hand. Mapping of finger positions to pitch and amplitude modulation are described in the paper. + [Sound Example 1](https://pub.uni-bielefeld.de/download/2707114/2707115) #### S2: Hand postures for articulated voice control This example illustrates how the hand posture control interface is used to render complex vowel transitions using a mapping of features such as formant frequencies and bandwidths and overall gain as described in the paper. + [Sound Example 2](https://pub.uni-bielefeld.de/download/2707114/2707131) #### S3: Interactive sonification of parameter mappings This is a number of sonifications of the iris data set where the finger bendings control different ranges or centers of the mapping interval. In all sonifications the class label is not used. The sounds provide different auditory views to one and the same dataset. + [Sound Example 3.1](https://pub.uni-bielefeld.de/download/2707114/2707117) + [Sound Example 3.2](https://pub.uni-bielefeld.de/download/2707114/2707116) + [Sound Example 3.3](https://pub.uni-bielefeld.de/download/2707114/2707119) + [Sound Example 3.4](https://pub.uni-bielefeld.de/download/2707114/2707118) + [Sound Example 3.5](https://pub.uni-bielefeld.de/download/2707114/2707120) #### S4: Audible Contrast Explorations This set of sonifications of the iris data set play mappings of all 3 classes of the iris data in a sequence, resulting in the perception of audible contrast between classes. The for sound example in turn are different mappings obtained by using the hand posture control interface. + [Sound Example 4.1](https://pub.uni-bielefeld.de/download/2707114/2707124) + [Sound Example 4.2](https://pub.uni-bielefeld.de/download/2707114/2707125) + [Sound Example 4.3](https://pub.uni-bielefeld.de/download/2707114/2707126) + [Sound Example 4.4](https://pub.uni-bielefeld.de/download/2707114/2707127)
Erscheinungsjahr
2001
Page URI
https://pub.uni-bielefeld.de/record/2707114

Zitieren

Hermann T, Nölker C, Ritter H. Supplementary Material for "Hand Postures for Sonification Control". Bielefeld University; 2001.
Hermann, T., Nölker, C., & Ritter, H. (2001). Supplementary Material for "Hand Postures for Sonification Control". Bielefeld University. doi:10.4119/unibi/2707114
Hermann, T., Nölker, C., and Ritter, H. (2001). Supplementary Material for "Hand Postures for Sonification Control". Bielefeld University.
Hermann, T., Nölker, C., & Ritter, H., 2001. Supplementary Material for "Hand Postures for Sonification Control", Bielefeld University.
T. Hermann, C. Nölker, and H. Ritter, Supplementary Material for "Hand Postures for Sonification Control", Bielefeld University, 2001.
Hermann, T., Nölker, C., Ritter, H.: Supplementary Material for "Hand Postures for Sonification Control". Bielefeld University (2001).
Hermann, Thomas, Nölker, Claudia, and Ritter, Helge. Supplementary Material for "Hand Postures for Sonification Control". Bielefeld University, 2001.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Volltext(e)
Titel
S1: Handposture-driven soundscape control
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
8a3c775e1a74051c207fc078fd97c841
Titel
S2: Hand postures for articulated voice control
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
2314f9bea8ebd7018d417b7a92568cd7
Titel
S3.1: Interactive sonification of parameter mappings
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
66a0970d7baff45e6e0e46ea0c7c44f7
Titel
S3.2: Interactive sonification of parameter mappings
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
2bc90e1a666f5269d02f47548516632c
Titel
S3.3: Interactive sonification of parameter mappings
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
4e933d140ba81ab404d9de43d3cc92e2
Titel
S3.4: Interactive sonification of parameter mappings
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
6eb979ab817248cbf8ca5a08fd109563
Titel
S3.5: Interactive sonification of parameter mappings
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
4b2832f21fdc1d8f3da6b15dfab923c8
Titel
S4.1: Audible Contrast Explorations
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
9bc91616fbe535f589dfde311cbf53ff
Titel
S4.2: Audible Contrast Explorations
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
dd457949e5ec79a8ea4a1a446a622442
Titel
S4.3: Audible Contrast Explorations
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
1d5a00b6cab8c465f1247ac659fb5600
Titel
S4.4: Audible Contrast Explorations
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-12T10:01:01Z
MD5 Prüfsumme
d3f2181b181b67bf2dcbcc40b216f48f

Material in PUB:
forms.relation..display
Hand Postures for Sonification Control
Hermann T, Nölker C, Ritter H (2002)
In: Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop, Revised Papers. Lecture Notes in Artificial Intelligence, 2298. Wachsmuth I, Sowa T (Eds); Berlin, Heidelberg: Springer: 307-316.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar