Modular Synthesis of Disfluencies for Conversational Speech Systems

Betz S, Wagner P, Schlangen D (2015)
Presented at the ESSV 2015, Eichstätt.

Download
OA
Conference Paper | Published | English
Abstract
It has been shown that dialogue systems benefit from incremental architectures to produce fast responses and to interact with the interlocutor in a more human-like way. The advantage of quick responses yields the disadvantage of running out of things to say for a while. In such occasions, humans tend to produce disfluencies as a listener-oriented strategy to signal the ongoing production process and to buy time for finalizing the turn. Introducing disfluency capabilities into a speech synthesis module of a dialogue system may therefore be a straightforward strategy towards conversational speech systems. Disfluencies are a very complex matter, they can take various chaining and nested forms in human communication. We do not attempt to equip our system with the full range of possible disfluent time-buying strategies found in human interaction. For a first perceptual evaluation of the most suitable synthetic disfluency strategy to be integrated into the dialogue system, we focus on three structural factors that are able to cover a wide range of attested disfluency patterns: lengthening, word cutoffs and pauses. This leads to several different configurations a disfluent sentence can take. Sentences from a spontaneous speech corpus were resynthesized in all possible configurations using Mary TTS. In order to identify euphone configurations, these stimuli were then presented to test subjects in a perception test.
Publishing Year
Conference
ESSV 2015
Location
Eichstätt
Conference Date
2015-03-25 – 2015-03-27
PUB-ID

Cite this

Betz S, Wagner P, Schlangen D. Modular Synthesis of Disfluencies for Conversational Speech Systems. Presented at the ESSV 2015, Eichstätt.
Betz, S., Wagner, P., & Schlangen, D. (2015). Modular Synthesis of Disfluencies for Conversational Speech Systems. Presented at the ESSV 2015, Eichstätt.
Betz, S., Wagner, P., and Schlangen, D. (2015).“Modular Synthesis of Disfluencies for Conversational Speech Systems”. Presented at the ESSV 2015, Eichstätt.
Betz, S., Wagner, P., & Schlangen, D., 2015. Modular Synthesis of Disfluencies for Conversational Speech Systems. Presented at the ESSV 2015, Eichstätt.
S. Betz, P. Wagner, and D. Schlangen, “Modular Synthesis of Disfluencies for Conversational Speech Systems”, Presented at the ESSV 2015, Eichstätt, 2015.
Betz, S., Wagner, P., Schlangen, D.: Modular Synthesis of Disfluencies for Conversational Speech Systems. Presented at the ESSV 2015, Eichstätt (2015).
Betz, Simon, Wagner, Petra, and Schlangen, David. “Modular Synthesis of Disfluencies for Conversational Speech Systems”. Presented at the ESSV 2015, Eichstätt, 2015.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2016-06-09T12:41:50Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar