Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)"
Hermann T, Hunt A (2005)
Bielefeld University.
Datenpublikation
Download
Creator
Hermann, ThomasUniBi 
;
Hunt, Andy
;
Hunt, AndyEinrichtung
Abstract / Bemerkung
This chapter places a special focus on those situations where there is a tight control loop (a real-time interactive collaboration) between the human user and the system producing the sonification. It explains the background (why humans appear to use interactive sonification as a natural tool for exploring the world) as well as describing the different methods and application domains.
Erscheinungsjahr
2005
Copyright und Lizenzen
Page URI
https://pub.uni-bielefeld.de/record/2704535
Zitieren
Hermann T, Hunt A. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University; 2005.
Hermann, T., & Hunt, A. (2005). Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University. doi:10.4119/unibi/2704535
Hermann, Thomas, and Hunt, Andy. 2005. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University.
Hermann, T., and Hunt, A. (2005). Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University.
Hermann, T., & Hunt, A., 2005. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)", Bielefeld University.
T. Hermann and A. Hunt, Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)", Bielefeld University, 2005.
Hermann, T., Hunt, A.: Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University (2005).
Hermann, Thomas, and Hunt, Andy. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University, 2005.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Open Database License (ODbL) v1.0:
Volltext(e)
Name
Titel
Example S11.1: Baby crying
Beschreibung
All human beings make a noise as soon as they are born. We continue to do so as we grow, but we increasingly monitor the reaction from the world.
source: www.freesfx.co.uk
Edited from (submitted by user amm00)
source: www.freesfx.co.uk
Edited from (submitted by user amm00)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
11035bf27c17a486922d26a01aefc861
Name
Titel
Example S11.2: Child playing
Beschreibung
Child playing with wooden bricks, then small stones, then wooden again.
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
64ef0bc83a3fc733bb30e2bc5d530437
Name
Titel
Example S11.3: Young children playing with pots and pans
Beschreibung
As children grow they explore the world constantly, in a multi-modal fashion, using touch and sound (as here) as well as sight, taste and smell, to intimately learn about the physics and chemistry of the world about them. They are like permanent scientists, running continual experiments.
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
a656dc0edf245a677cf6f4acdfa63269
Name
Titel
Example S11.4: child asking parent for something
Beschreibung
Gradually, as children grow, they begin to use communication to get things done (mostly by asking a parent), in addition to directly exploring the world. The direct exploration often takes a back-seat in favour of semantic and syntactic communication. This is reflected in many of our computer interfaces, and in this chapter we speculate on what we have ‘lost’ by concentrating on this mode of relating to the world.
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
f8d992973d52eef77bb122860942a439
Name
Titel
Example S11.5: someone rapidly changing channels on a tv with others complaining!
Beschreibung
This is a mocked-up example of a commonly experienced situation. When you hold the remote control, everything seems fluid and fine. When others take charge it is disrupting and annoying! This leads us to believe that being at the heart of an interface control loop is very important to a human user (and also warns us of the danger of demonstrating software where we are happily ‘channel hopping’ to the annoyance of the audience)!
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
72a4742ebf54ee1dad7ca7be845b7db0
Name
Titel
Example S11.6: Sounds made by stone tools
Beschreibung
Rocks being knocked and scraped together rhythmically; like a caveman!
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
ea716c369157e4f3ee1b74647b1d755c
Name
Titel
Example S11.7: car engine
Beschreibung
Cars are complex machines, and mechanics develop highly-tuned skills of listening to and diagnosing problems.
source: www.freesfx.co.uk
Edited from (submitted by user mckinneysound)
source: www.freesfx.co.uk
Edited from (submitted by user mckinneysound)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
2a0c03a89f5d57fac1627ff6c422df08
Name
Titel
Example S11.8: washing machine
Beschreibung
As with the above car engine example, washing machine problems are often diagnosed by sound. It seems that in the mechanical world we naturally use sound to inform us of complex, ‘hidden’ behaviours. Our challenge is that this should also be true for the world of digital data in general.
source: www.freesound.org
Edited from (submitted by user Percy Duke)
source: www.freesound.org
Edited from (submitted by user Percy Duke)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
d4e1f71ae035c0e3d5b780d6132af836
Name
Titel
Example S11.9: Unconscious sounds made while thinking
Beschreibung
Drumming fingers and humming while thinking. Helpful to the thinker – really annoying to anyone else who has to share a room with them!
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
3aa7df708bc80bf028c6496ee0ec5930
Name
Titel
Example S11.10: Sounds of a noisy radio signal
Beschreibung
This is a typical set of sounds encountered while trying to tune in to a distant, noisy radio signal. Often the user finds they can hear it clearly (because they operated the controls to suit their own ear-brain systems) while others in the room cannot distinguish the information in the signal.
source: www.freesound.org
Edited blend of two sound sources:
1. submitted by user J – Luc
2. submitted by user parabolix
source: www.freesound.org
Edited blend of two sound sources:
1. submitted by user J – Luc
2. submitted by user parabolix
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
971123ff27567ae3c157fe4393e467ee
Name
Titel
Example S11.11: Beginner violin player
Beschreibung
This is the sort of sound made by someone learning to play an instrument. Usually it is fine for the person learning, and indeed a vital part of the learning process (as they receive continual feedback). However, the same sound is not as pleasant to other listeners because they are not part of the control loop.
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
0897b91e79e4b9b0244ea25334c77700
Name
Titel
Example S11.12: oboe
Beschreibung
The oboe is a very hard instrument to learn, and beginners often cannot make a sound, yet it is considered to be a very expressive instrument. This may illustrate a trade-off in accessibilitiy versus long-term control intimacy.
source: www.freesound.org
Edited from (submitted by user Thirsk)
source: www.freesound.org
Edited from (submitted by user Thirsk)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
225a169585923ffe2a61b241620b5db8
Name
Titel
Example S11.13: Guitar (intermediate)
Beschreibung
Here is an intermediate guitar-player. Clearly the basics have been accomplished, but there are many years of mastery still left to explore. Interfaces such as the guitar and piano offer beginners are more immediate feedback experience than something like the oboe, but maybe the individual notes (especially long ones) are not as expressive as the oboe.
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
69cd15bd8fdb22a8284cbd36ed8e4a01
Name
Titel
Example S11.14: Sounds of computer usage
Beschreibung
Sounds made while moving the computer mouse on its pad and clicking buttons.
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
eccdf5b5c38bcb6401f5b28d244f5694
Name
Titel
Example S11.15: 'blinkers' in a modern car
Beschreibung
This is the sound of ‘blinkers’ or ‘indicators’ in a modern car. Old cars had blinkers which made sound as a by-product of their relays. Modern ones do not need to make sound, but it is felt so useful to the user experience that the sound now has to be synthesised.
source: www.freesound.org
Edited from (submitted by user morgantj)
source: www.freesound.org
Edited from (submitted by user morgantj)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
551d37a939c623ac2ce2cf951ef0988b
Name
Titel
Example S11.16: Typical computer sounds
Beschreibung
The sounds of audio beeps etc when using a computer (a montage of 'startup', 'error' etc).
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
ca4c4a830c1928126eea2f8404f627c5
Name
Titel
Example S11.17: A glass being moved around on a table
Beschreibung
This is a typical sound from everyday interaction. Someone is idly 'playing around with' a glass on a table. The sound forms a continuous stream of feedback about the object's position, speed, the table surface, whether there is danger of the glass breaking, etc.
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
72189d1483b66248bc3aec78a44d80cb
Name
Titel
Example S11.18: seatbelt warning after starting a car
Beschreibung
Modern cars often used sampled or synthesised sounds to give a warning to their users, as in this case where the driver has not yet fastened their safety belt. The following example extends this idea.
source: www.freesound.org
Edited from (submitted by user amliebsch)
source: www.freesound.org
Edited from (submitted by user amliebsch)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
68c7b2c976d5451aea097606baa88780
Name
Titel
Example S11.19: Parameterised seatbelt warning
Beschreibung
An edited example showing the effect of simply ‘speeding up’ and playing the seatbelt warning louder, in response to a driver who accelerates without their seatbelt in place.
source: www.freesound.org + editing
Edited from (submitted by user joedeshon)
source: www.freesound.org + editing
Edited from (submitted by user joedeshon)
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
1fd47930e4149ae9da2bf84c04c653b1
Name
Titel
Example S11.20: Switches
Beschreibung
Switches (repeated naturally and repeated by sampling)
source: Self recorded
source: Self recorded
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
39380ac0f42226d9796be2bf94d4dd5a
Name
Titel
Example S11.21: Interactive parameter mapping
Beschreibung
The Interaction video shows a simple GUI that allows to interactively adjust mapping parameters while the data sonification is played in a loop with the actual parameters. This allows the user to actively query different ‘sonic views’ that deliver equally valid information about the data. In an ongoing process the user can steadily increase their insight into the data structure.
source: From Thomas Hermann
source: From Thomas Hermann
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
fb824061c679082e9b8eb4aa1b36086e
Name
Titel
Example S11.22: Evolutionary Optimization of Parameter Mapping sonifications
Beschreibung
The series of parameter-mapping sonifications are selected children (in evolutionary algorithms sometime called mutations) in the evolutionary process where the user provides the fitness function by rating the offered alternatives and thereby directing the process. Here the user aims at discovering the clustering structure as best as possible. The sonification get more and more structured as the mapping evolves towards a projection of data on the time axis so that the groups audibly split in grain clusters.
source: From Thomas Hermann
source: From Thomas Hermann
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
edaec7a921999198a425ec8bba627574
Name
Titel
Example S11.23: Shoogle demo video
Beschreibung
The shoogle system implements a Model-based Sonification that configures the setup of objects in a virtual container from existing text messages in a phone. In consequence, physical interactions allow the user to become aware of, or to actively explore the available messages without looking to the tiny screen.
source: From John Williamson, S. Hughes and Rod Murray-Smith with permission
source: From John Williamson, S. Hughes and Rod Murray-Smith with permission
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-12T10:00:58Z
MD5 Prüfsumme
59fa931b5b80b73f053b79827d5a447e
Material in PUB:
Wird zitiert von
Guest Editors' Introduction: An Introduction to Interactive Sonification
Hermann T, Hunt A (2005)
IEEE MultiMedia 12(2): 20-24.
Hermann T, Hunt A (2005)
IEEE MultiMedia 12(2): 20-24.
Google Scholar