Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)"

Hermann T, Hunt A (2005)
Bielefeld University.

Download
OA
OA Example S11.2: Child playing
OA Example S11.3: Young children playing with pots and pans
All
Research Data
Creator
;
Abstract
This chapter places a special focus on those situations where there is a tight control loop (a real-time interactive collaboration) between the human user and the system producing the sonification. It explains the background (why humans appear to use interactive sonification as a natural tool for exploring the world) as well as describing the different methods and application domains.
Publishing Year
Data Re-Use License
This Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)" is made available under the Open Database License: http://opendatacommons.org/licenses/odbl/1.0. Any rights in individual contents of the database are licensed under the Database Contents License: http://opendatacommons.org/licenses/dbcl/1.0/
PUB-ID

Cite this

Hermann T, Hunt A. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University; 2005.
Hermann, T., & Hunt, A. (2005). Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University.
Hermann, T., and Hunt, A. (2005). Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University.
Hermann, T., & Hunt, A., 2005. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)", Bielefeld University.
T. Hermann and A. Hunt, Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)", Bielefeld University, 2005.
Hermann, T., Hunt, A.: Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University (2005).
Hermann, Thomas, and Hunt, Andy. Supplementary Material for "An Introduction to Interactive Sonification (Guest Editors' Introduction)". Bielefeld University, 2005.
All files available under the following license(s):
Main File(s)
File Name
File Title
Example S11.1: Baby crying
Description
All human beings make a noise as soon as they are born. We continue to do so as we grow, but we increasingly monitor the reaction from the world.
source: www.freesfx.co.uk
Edited from (submitted by user amm00)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.2: Child playing
Description
Child playing with wooden bricks, then small stones, then wooden again.
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.3: Young children playing with pots and pans
Description
As children grow they explore the world constantly, in a multi-modal fashion, using touch and sound (as here) as well as sight, taste and smell, to intimately learn about the physics and chemistry of the world about them. They are like permanent scientists, running continual experiments.
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.4: child asking parent for something
Description
Gradually, as children grow, they begin to use communication to get things done (mostly by asking a parent), in addition to directly exploring the world. The direct exploration often takes a back-seat in favour of semantic and syntactic communication. This is reflected in many of our computer interfaces, and in this chapter we speculate on what we have ‘lost’ by concentrating on this mode of relating to the world.
source: www.freesfx.co.uk
Edited from (submitted by user andyt)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.5: someone rapidly changing channels on a tv with others complaining!
Description
This is a mocked-up example of a commonly experienced situation. When you hold the remote control, everything seems fluid and fine. When others take charge it is disrupting and annoying! This leads us to believe that being at the heart of an interface control loop is very important to a human user (and also warns us of the danger of demonstrating software where we are happily ‘channel hopping’ to the annoyance of the audience)!
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.6: Sounds made by stone tools
Description
Rocks being knocked and scraped together rhythmically; like a caveman!
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.7: car engine
Description
Cars are complex machines, and mechanics develop highly-tuned skills of listening to and diagnosing problems.
source: www.freesfx.co.uk
Edited from (submitted by user mckinneysound)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.8: washing machine
Description
As with the above car engine example, washing machine problems are often diagnosed by sound. It seems that in the mechanical world we naturally use sound to inform us of complex, ‘hidden’ behaviours. Our challenge is that this should also be true for the world of digital data in general.
source: www.freesound.org
Edited from (submitted by user Percy Duke)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Name
File Title
Example S11.9: Unconscious sounds made while thinking
Description
Drumming fingers and humming while thinking. Helpful to the thinker – really annoying to anyone else who has to share a room with them!
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.10: Sounds of a noisy radio signal
Description
This is a typical set of sounds encountered while trying to tune in to a distant, noisy radio signal. Often the user finds they can hear it clearly (because they operated the controls to suit their own ear-brain systems) while others in the room cannot distinguish the information in the signal.
source: www.freesound.org
Edited blend of two sound sources:
1. submitted by user J – Luc
2. submitted by user parabolix
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.11: Beginner violin player
Description
This is the sort of sound made by someone learning to play an instrument. Usually it is fine for the person learning, and indeed a vital part of the learning process (as they receive continual feedback). However, the same sound is not as pleasant to other listeners because they are not part of the control loop.
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.12: oboe
Description
The oboe is a very hard instrument to learn, and beginners often cannot make a sound, yet it is considered to be a very expressive instrument. This may illustrate a trade-off in accessibilitiy versus long-term control intimacy.
source: www.freesound.org
Edited from (submitted by user Thirsk)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.13: Guitar (intermediate)
Description
Here is an intermediate guitar-player. Clearly the basics have been accomplished, but there are many years of mastery still left to explore. Interfaces such as the guitar and piano offer beginners are more immediate feedback experience than something like the oboe, but maybe the individual notes (especially long ones) are not as expressive as the oboe.
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.14: Sounds of computer usage
Description
Sounds made while moving the computer mouse on its pad and clicking buttons.
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.15: 'blinkers' in a modern car
Description
This is the sound of ‘blinkers’ or ‘indicators’ in a modern car. Old cars had blinkers which made sound as a by-product of their relays. Modern ones do not need to make sound, but it is felt so useful to the user experience that the sound now has to be synthesised.
source: www.freesound.org
Edited from (submitted by user morgantj)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.16: Typical computer sounds
Description
The sounds of audio beeps etc when using a computer (a montage of 'startup', 'error' etc).
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.17: A glass being moved around on a table
Description
This is a typical sound from everyday interaction. Someone is idly 'playing around with' a glass on a table. The sound forms a continuous stream of feedback about the object's position, speed, the table surface, whether there is danger of the glass breaking, etc.
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.18: seatbelt warning after starting a car
Description
Modern cars often used sampled or synthesised sounds to give a warning to their users, as in this case where the driver has not yet fastened their safety belt. The following example extends this idea.
source: www.freesound.org
Edited from (submitted by user amliebsch)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.19: Parameterised seatbelt warning
Description
An edited example showing the effect of simply ‘speeding up’ and playing the seatbelt warning louder, in response to a driver who accelerates without their seatbelt in place.
source: www.freesound.org + editing
Edited from (submitted by user joedeshon)
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.20: Switches
Description
Switches (repeated naturally and repeated by sampling)
source: Self recorded
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.21: Interactive parameter mapping
Description
The Interaction video shows a simple GUI that allows to interactively adjust mapping parameters while the data sonification is played in a loop with the actual parameters. This allows the user to actively query different ‘sonic views’ that deliver equally valid information about the data. In an ongoing process the user can steadily increase their insight into the data structure.
source: From Thomas Hermann
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.22: Evolutionary Optimization of Parameter Mapping sonifications
Description
The series of parameter-mapping sonifications are selected children (in evolutionary algorithms sometime called mutations) in the evolutionary process where the user provides the fitness function by rating the offered alternatives and thereby directing the process. Here the user aims at discovering the clustering structure as best as possible. The sonification get more and more structured as the mapping evolves towards a projection of data on the time axis so that the groups audibly split in grain clusters.
source: From Thomas Hermann
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z
File Title
Example S11.23: Shoogle demo video
Description
The shoogle system implements a Model-based Sonification that configures the setup of objects in a virtual container from existing text messages in a phone. In consequence, physical interactions allow the user to become aware of, or to actively explore the available messages without looking to the tiny screen.
source: From John Williamson, S. Hughes and Rod Murray-Smith with permission
Access Level
OA Open Access
Last Uploaded
2016-04-05T07:16:14Z

This data publication is cited in the following publications:
2017334
Guest Editors' Introduction: An Introduction to Interactive Sonification
Hermann T, Hunt A (2005)
IEEE MultiMedia 12(2): 20-24.
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar