Bayesian Networks for Speech and Image Integration

Wachsmuth S, Sagerer G (2002)
In: Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002). Edmonton, Alberta, Canada: 300-306.

Conference Paper | Published | English

No fulltext has been uploaded

Abstract
The realization of natural human-computer interfaces suffers from a wide range of restrictions concerning noisy data, vague meanings, and context dependence. An essential aspect of everyday communication is the ability of humans to ground verbal interpretations in visual perception. Thus, the system has to be able to solve the correspondence problem of relating verbal and visual descriptions of the same object. This contribution proposes a new and innovative solution to this problem using Bayesian networks. In order to capture vague meanings of adjectives used by the speaker, psycholinguistic experiments are evaluated. Object recognition errors are taken into account by conditional probabilities estimated on test sets. The Bayesian network is dynamically built up from verbal object description and is evaluated by an inference technique combining bucket elimination and conditioning. Results show that speech and image data is interpreted more robustly in the combined case than in the case of isolated interpretations.
Publishing Year
PUB-ID

Cite this

Wachsmuth S, Sagerer G. Bayesian Networks for Speech and Image Integration. In: Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002). Edmonton, Alberta, Canada; 2002: 300-306.
Wachsmuth, S., & Sagerer, G. (2002). Bayesian Networks for Speech and Image Integration. Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002), 300-306.
Wachsmuth, S., and Sagerer, G. (2002). “Bayesian Networks for Speech and Image Integration” in Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002) (Edmonton, Alberta, Canada), 300-306.
Wachsmuth, S., & Sagerer, G., 2002. Bayesian Networks for Speech and Image Integration. In Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002). Edmonton, Alberta, Canada, pp. 300-306.
S. Wachsmuth and G. Sagerer, “Bayesian Networks for Speech and Image Integration”, Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002), Edmonton, Alberta, Canada: 2002, pp.300-306.
Wachsmuth, S., Sagerer, G.: Bayesian Networks for Speech and Image Integration. Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002). p. 300-306. Edmonton, Alberta, Canada (2002).
Wachsmuth, Sven, and Sagerer, Gerhard. “Bayesian Networks for Speech and Image Integration”. Proc. of 18th National Conf. on Artificial Intelligence (AAAI-2002). Edmonton, Alberta, Canada, 2002. 300-306.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar