Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases

Käster T, Pfeiffer M, Bauckhage C, Sagerer G (2003)
In: Proc. International Conference on Multimodal Interfaces (ICMI’03). ACM: 180-187.

Conference Paper | Published | English

No fulltext has been uploaded

Author
; ; ;
Abstract
Given the size of todays professional image databases, the standard approach to object- or theme-related image retrieval is to interactively navigate through the content. But as most users of such databases are designers or artists who do not have a technical background, navigation interfaces must be intuitive to use and easy to learn. This paper reports on efforts towards this goal. We present a system for intuitive image retrieval that features different modalities for interaction. Apart from conventional input devices like mouse or keyboard it is also possible to use speech or haptic gesture to indicate what kind of images one is looking for.
Seeing a selection of images on the screen, the user provides relevance feedback to narrow the choice of motifs presented next. This is done either by scoring whole images or by choosing certain image regions. In order to derive consistent reactions from multimodal user input, asynchronous integration of modalities and probabilistic reasoning based on Bayesian networks are applied.
After addressing technical details, we will discuss a series of usability experiments, which we conducted to examine the impact of multimodal input facilities on interactive image retrieval. The results indicate that users appreciate multimodality. While we observed little decrease in task performance, measures of contentment exceeded those for conventional input devices.
Publishing Year
PUB-ID

Cite this

Käster T, Pfeiffer M, Bauckhage C, Sagerer G. Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases. In: Proc. International Conference on Multimodal Interfaces (ICMI’03). ACM; 2003: 180-187.
Käster, T., Pfeiffer, M., Bauckhage, C., & Sagerer, G. (2003). Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases. Proc. International Conference on Multimodal Interfaces (ICMI’03), 180-187.
Käster, T., Pfeiffer, M., Bauckhage, C., and Sagerer, G. (2003). “Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases” in Proc. International Conference on Multimodal Interfaces (ICMI’03) (ACM), 180-187.
Käster, T., et al., 2003. Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases. In Proc. International Conference on Multimodal Interfaces (ICMI’03). ACM, pp. 180-187.
T. Käster, et al., “Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases”, Proc. International Conference on Multimodal Interfaces (ICMI’03), ACM, 2003, pp.180-187.
Käster, T., Pfeiffer, M., Bauckhage, C., Sagerer, G.: Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases. Proc. International Conference on Multimodal Interfaces (ICMI’03). p. 180-187. ACM (2003).
Käster, Thomas, Pfeiffer, Michael, Bauckhage, Christian, and Sagerer, Gerhard. “Combining Speech and Haptics for Intuitive and Efficient Navigation through Image Databases”. Proc. International Conference on Multimodal Interfaces (ICMI’03). ACM, 2003. 180-187.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar