Interactive Hesitation Synthesis: Modelling and Evaluation

Betz S, Carlmeyer B, Wagner P, Wrede B (2018)
Multimodal Technologies and Interaction 2(1): 9.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 755.78 KB
Abstract / Bemerkung
Conversational spoken dialogue systems that interact with the user rather than merely reading text can be equipped with hesitations to manage the dialogue flow and the users' attention. Based on a series of empirical studies, we built an elaborated hesitation synthesis strategy for dialogue systems that inserts hesitations of scalable extent wherever needed in the ongoing utterance. So far, evaluations of hesitating systems have shown that synthesis quality is affected negatively by hesitations, but that there is improvement in interaction quality. We argue that due to its conversational nature, hesitation synthesis needs interactive evaluation rather than traditional MOS-based questionnaires. To prove this point, we dually evaluate our system’s speech synthesis component: on the one hand, linked to the dialogue system evaluation, on the other hand, in the traditional MOS way. This way we are able to analyze and discuss differences that arise due to the evaluation methodology. Our results suggest that MOS scales are not sufficient to assess speech synthesis quality, which has implications for future research that are discussed in this paper. Furthermore, our results indicate that hesitations work well to increase task performance and that an elaborated strategy is necessary to avoid likability issues.
Stichworte
biphonetics
Erscheinungsjahr
2018
Zeitschriftentitel
Multimodal Technologies and Interaction
Band
2
Ausgabe
1
Art.-Nr.
9
ISSN
2414-4088
Page URI
https://pub.uni-bielefeld.de/record/2918565

Zitieren

Betz S, Carlmeyer B, Wagner P, Wrede B. Interactive Hesitation Synthesis: Modelling and Evaluation. Multimodal Technologies and Interaction. 2018;2(1): 9.
Betz, S., Carlmeyer, B., Wagner, P., & Wrede, B. (2018). Interactive Hesitation Synthesis: Modelling and Evaluation. Multimodal Technologies and Interaction, 2(1), 9. https://doi.org/10.3390/mti2010009
Betz, Simon, Carlmeyer, Birte, Wagner, Petra, and Wrede, Britta. 2018. “Interactive Hesitation Synthesis: Modelling and Evaluation”. Multimodal Technologies and Interaction 2 (1): 9.
Betz, S., Carlmeyer, B., Wagner, P., and Wrede, B. (2018). Interactive Hesitation Synthesis: Modelling and Evaluation. Multimodal Technologies and Interaction 2:9.
Betz, S., et al., 2018. Interactive Hesitation Synthesis: Modelling and Evaluation. Multimodal Technologies and Interaction, 2(1): 9.
S. Betz, et al., “Interactive Hesitation Synthesis: Modelling and Evaluation”, Multimodal Technologies and Interaction, vol. 2, 2018, : 9.
Betz, S., Carlmeyer, B., Wagner, P., Wrede, B.: Interactive Hesitation Synthesis: Modelling and Evaluation. Multimodal Technologies and Interaction. 2, : 9 (2018).
Betz, Simon, Carlmeyer, Birte, Wagner, Petra, and Wrede, Britta. “Interactive Hesitation Synthesis: Modelling and Evaluation”. Multimodal Technologies and Interaction 2.1 (2018): 9.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:58Z
MD5 Prüfsumme
8b214fc7040537a1a583ab144cbfc0ff


Link(s) zu Volltext(en)
Access Level
OA Open Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Quellen

Preprint: 10.20944/preprints201712.0058.v1

Suchen in

Google Scholar