Gesture desk - An integrated multi-modal gestural workplace for sonification

Hermann T, Henning T, Ritter H (2003)
In: Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Camurri A, Volpe G (Eds); Berlin: Springer: 369-379.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Konferenzbeitrag | Veröffentlicht | Englisch
Autor
Herausgeber
;
Abstract / Bemerkung
This paper presents the gesture desk, a new platform for a human-computer interface at a regular computer workplace. It extends classical input devices like keyboard and mouse by arm and hand gestures, without the need to use any inconvenient accessories like data gloves or markers. A central element is a "gesture box" containing two infrared cameras and a color camera which is positioned under a glass desk. Arm and hand motions are tracked in three dimensions. A synchronizer board has been developed to provide an active glare-free IR-illumination for robust body and hand tracking. As a first application, we demonstrate interactive real-time browsing and querying of auditory self-organizing maps (AuSOMs). An AuSOM is a combined visual and auditory presentation of high-dimensional data sets. Moving the hand above the desk surface allows to select neurons on the map and to manipulate how they contribute to data sonification. Each neuron is associated with a prototype vector in high-dimensional space, so that a set of 2D-topologically ordered feature maps is queried simultaneously. The level of detail is selected by hand altitude over the table surface, allowing to emphasize or deemphasize neurons on the map.
Erscheinungsjahr
Titel des Konferenzbandes
Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915
Seite
369-379
Konferenz
GW 2003
Konferenzort
Genova, Italy
Konferenzdatum
2003-04-15/2003-04-17
ISSN
PUB-ID

Zitieren

Hermann T, Henning T, Ritter H. Gesture desk - An integrated multi-modal gestural workplace for sonification. In: Camurri A, Volpe G, eds. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Berlin: Springer; 2003: 369-379.
Hermann, T., Henning, T., & Ritter, H. (2003). Gesture desk - An integrated multi-modal gestural workplace for sonification. In A. Camurri & G. Volpe (Eds.), Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915 (pp. 369-379). Berlin: Springer.
Hermann, T., Henning, T., and Ritter, H. (2003). “Gesture desk - An integrated multi-modal gestural workplace for sonification” in Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915, Camurri, A., and Volpe, G. eds. (Berlin: Springer), 369-379.
Hermann, T., Henning, T., & Ritter, H., 2003. Gesture desk - An integrated multi-modal gestural workplace for sonification. In A. Camurri & G. Volpe, eds. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Berlin: Springer, pp. 369-379.
T. Hermann, T. Henning, and H. Ritter, “Gesture desk - An integrated multi-modal gestural workplace for sonification”, Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915, A. Camurri and G. Volpe, eds., Berlin: Springer, 2003, pp.369-379.
Hermann, T., Henning, T., Ritter, H.: Gesture desk - An integrated multi-modal gestural workplace for sonification. In: Camurri, A. and Volpe, G. (eds.) Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. p. 369-379. Springer, Berlin (2003).
Hermann, Thomas, Henning, Thomas, and Ritter, Helge. “Gesture desk - An integrated multi-modal gestural workplace for sonification”. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Ed. Antonio Camurri and Gualtiero Volpe. Berlin: Springer, 2003. 369-379.