Confirmation detection in human-agent interaction using non-lexical speech cues

Brandt M, Wrede B, Kummert F, Schillingmann L (2017)
Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA.

Download
OA 2.58 MB
Conference Paper | English
Abstract
Even if only the acoustic channel is considered, human communication is highly multi-modal. Non-lexical cues provide a variety of information such as emotion or agreement. The ability to process such cues is highly relevant for spoken dialog systems, especially in assistance systems. In this paper we focus on the recognition of non-lexical confirmations such as "mhm", as they enhance the system's ability to accurately interpret human intent in natural communication. The architecture uses a Support Vector Machine to detect confirmations based on acoustic features. In a systematic comparison, several feature sets were evaluated for their performance on a corpus of human-agent interaction in a setting with naive users including elderly and cognitively impaired people. Our results show that using stacked formants as features yield an accuracy of 84% outperforming regular formants and MFCC or pitch based features for online classification.
Publishing Year
Conference
AAAI Symposium on Natural Communication for Human-Robot Collaboration
Location
Arlington, VA
Conference Date
2017-11-09 – 2017-11-11
PUB-ID

Cite this

Brandt M, Wrede B, Kummert F, Schillingmann L. Confirmation detection in human-agent interaction using non-lexical speech cues. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA.
Brandt, M., Wrede, B., Kummert, F., & Schillingmann, L. (2017). Confirmation detection in human-agent interaction using non-lexical speech cues. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA.
Brandt, M., Wrede, B., Kummert, F., and Schillingmann, L. (2017).“Confirmation detection in human-agent interaction using non-lexical speech cues”. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA.
Brandt, M., et al., 2017. Confirmation detection in human-agent interaction using non-lexical speech cues. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA.
M. Brandt, et al., “Confirmation detection in human-agent interaction using non-lexical speech cues”, Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA, 2017.
Brandt, M., Wrede, B., Kummert, F., Schillingmann, L.: Confirmation detection in human-agent interaction using non-lexical speech cues. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA (2017).
Brandt, Mara, Wrede, Britta, Kummert, Franz, and Schillingmann, Lars. “Confirmation detection in human-agent interaction using non-lexical speech cues”. Presented at the AAAI Symposium on Natural Communication for Human-Robot Collaboration, Arlington, VA, 2017.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Main File(s)
Access Level
OA Open Access
Last Uploaded
2017-12-06T09:10:43Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Sources

arXiv 1710.00171

Search this title in

Google Scholar