Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface"

Hermann T, Krause J, Ritter H (2002)
Bielefeld University.

Datenpublikation
 
Download
OA
OA nneurons_15.wav
OA nneurons_10.wav
Alle
Creator
Abstract / Bemerkung
This paper presents a new interface for controlling sonification models. A haptic controller interface is developed which allows both to manipulate a sonification model, e.g. by interacting with it and to provide a haptic data representation. A variety of input types are supported with a hand-sized interface, including shaking, squeezing, hammering, moving, rotating and accelerating. The paper presents details on the interface under development and demonstrates application of the device for controlling a sonification model. For this purpose, the Data-Solid Sonification Model is introduced, which provides an acoustic representation of the local neighborhood relations in high-dimensional datasets for binary classification problems. The model is parameterized by a reduced data representation obtained from a growing neural gas network. Sound examples are given to demonstrate the device and the sonification model. ## Sound Demonstrations for the Audio-Haptic Ball Interface * #### Sounds for atomic collisions: Each model mass is assigned a material according to the data within the neurons voronoi cell. In our situation, binary classification data is used and the object type is either A (or B) if data from class A (or B) dominates the cell. + Collision between a A object with A object: [sound](https://pub.uni-bielefeld.de/download/2704140/2704141) (wood) + Collision between a B object and a B object: [sound](https://pub.uni-bielefeld.de/download/2704140/2704142) (plastic) + Collision between a A object and a B object: [sound](https://pub.uni-bielefeld.de/download/2704140/2704143) (glass) * #### Table 1: Sound examples for synthetic datasets from binary classification problems
File/Track:
  • A) two separated classes -- sound
  • B) two classes showing little overlap along one axis  -- sound
  • C) two classes that overlap - inseparable classes -- sound
Description: The sonification model was excited by shaking the interface device. The shaking activation is given by the acceleration a_x(t), a_y(t) . During the first half of the sound examples, the interface is shaken along the x axis, during the second half along the y axis.
Duration: about 5 sec.
* #### Table 2: Sound examples for Data solid sonifications using a GNG for the dataset (B) (see above) for different network complexities.
File/Track:
Description: Shaking excitation of the dataset with increasing network complexity.
Duration: about 2 sec / example
* Sound Example for shaking while GNG adaptation proceeds, and thus while the data-solid structure changes over time: [sound example](https://pub.uni-bielefeld.de/download/2704140/2704153) . It can be heard that with ongoing GNG growth more and more neurons exist (more collisions). From the pitch it can be perceived that the number of data points that have a neuron as its nearest neighbor decreases - new neurons are added between neurons that are frequently activated.
Erscheinungsjahr
2002
Copyright und Lizenzen
Page URI
https://pub.uni-bielefeld.de/record/2704140

Zitieren

Hermann T, Krause J, Ritter H. Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University; 2002.
Hermann, T., Krause, J., & Ritter, H. (2002). Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University. doi:10.4119/unibi/2704140
Hermann, Thomas, Krause, Jan, and Ritter, Helge. 2002. Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University.
Hermann, T., Krause, J., and Ritter, H. (2002). Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University.
Hermann, T., Krause, J., & Ritter, H., 2002. Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface", Bielefeld University.
T. Hermann, J. Krause, and H. Ritter, Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface", Bielefeld University, 2002.
Hermann, T., Krause, J., Ritter, H.: Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University (2002).
Hermann, Thomas, Krause, Jan, and Ritter, Helge. Supplementary Material for "Real-Time Control of Sonification Models with an Audio-Haptic Interface". Bielefeld University, 2002.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
e5ceb898326f16e71616f0f1eeb233c6
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
7eec45a91a73d9ea0395d353efb35055
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
f49b8a42469867c5c2d1d322883e6d2f
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
c403b0ac171b86fec5db6de2777068a9
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
0f3795350a93fa21c3cd0362adcb44aa
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
c435e1bbd56ae3719772eba2a4454d2c
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
82d7a69ff0c52d860f8c6775e5a18b6a
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
13e8b9b5c72778bc31888ea34b3aa554
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
5a21a59d747e2f0602bcfe3289a32b69
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
ca933bd2bca77c16f202e8c6bd1c1939
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
1c4c9c782a38eb501ca239956cc3251b
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
751a6753c84a0ebf5b7a7e2fa9c86752
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-25T06:35:19Z
MD5 Prüfsumme
65862afc412e496421d1b1e5829cfcde


Material in PUB:
Wird zitiert von
Real-Time Control of Sonification Models with an Audio-Haptic Interface
Hermann T, Krause J, Ritter H (2002)
In: Proceedings of the International Conference on Auditory Display. Nakatsu R, Kawahara H (Eds); Kyoto, Japan: ICAD: 82-86.
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar