Gesture desk - An integrated multi-modal gestural workplace for sonification

Hermann T, Henning T, Ritter H (2003)
In: Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Camurri A, Volpe G (Eds);Berlin: Springer: 369-379.

Conference Paper | Published | English

No fulltext has been uploaded

Author
Editor
Camurri, Antonio ; Volpe, Gualtiero
Abstract
This paper presents the gesture desk, a new platform for a human-computer interface at a regular computer workplace. It extends classical input devices like keyboard and mouse by arm and hand gestures, without the need to use any inconvenient accessories like data gloves or markers. A central element is a "gesture box" containing two infrared cameras and a color camera which is positioned under a glass desk. Arm and hand motions are tracked in three dimensions. A synchronizer board has been developed to provide an active glare-free IR-illumination for robust body and hand tracking. As a first application, we demonstrate interactive real-time browsing and querying of auditory self-organizing maps (AuSOMs). An AuSOM is a combined visual and auditory presentation of high-dimensional data sets. Moving the hand above the desk surface allows to select neurons on the map and to manipulate how they contribute to data sonification. Each neuron is associated with a prototype vector in high-dimensional space, so that a set of 2D-topologically ordered feature maps is queried simultaneously. The level of detail is selected by hand altitude over the table surface, allowing to emphasize or deemphasize neurons on the map.
Publishing Year
Conference
GW 2003
Location
Genova, Italy
Conference Date
2003-04-15/2003-04-17
ISSN
PUB-ID

Cite this

Hermann T, Henning T, Ritter H. Gesture desk - An integrated multi-modal gestural workplace for sonification. In: Camurri A, Volpe G, eds. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Berlin: Springer; 2003: 369-379.
Hermann, T., Henning, T., & Ritter, H. (2003). Gesture desk - An integrated multi-modal gestural workplace for sonification. In A. Camurri & G. Volpe (Eds.), Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915 (pp. 369-379). Berlin: Springer.
Hermann, T., Henning, T., and Ritter, H. (2003). “Gesture desk - An integrated multi-modal gestural workplace for sonification” in Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915, ed. A. Camurri and G. Volpe (Berlin: Springer), 369-379.
Hermann, T., Henning, T., & Ritter, H., 2003. Gesture desk - An integrated multi-modal gestural workplace for sonification. In A. Camurri & G. Volpe, eds. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Berlin: Springer, pp. 369-379.
T. Hermann, T. Henning, and H. Ritter, “Gesture desk - An integrated multi-modal gestural workplace for sonification”, Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915, A. Camurri and G. Volpe, eds., Berlin: Springer, 2003, pp.369-379.
Hermann, T., Henning, T., Ritter, H.: Gesture desk - An integrated multi-modal gestural workplace for sonification. In: Camurri, A. and Volpe, G. (eds.) Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. p. 369-379. Springer, Berlin (2003).
Hermann, Thomas, Henning, Thomas, and Ritter, Helge. “Gesture desk - An integrated multi-modal gestural workplace for sonification”. Gesture-Based Communication in Human-Computer Interaction, 5th International Gesture Workshop. Selected Revised Papers. Lecture Notes in Computer Science, 2915. Ed. Antonio Camurri and Gualtiero Volpe. Berlin: Springer, 2003. 369-379.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar