Audio-visual expressions of attitude: How many different attitudes can perceivers decode?

Mixdorff H, Hönemann A, Rilliard A, Lee T, Ma MKH (2017)
SPEECH COMMUNICATION 95: 114-126.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Mixdorff, Hansjoerg; Hönemann, AngelikaUniBi; Rilliard, Albert; Lee, Tan; Ma, Matthew K. H.
Abstract / Bemerkung
Based on the paradigm by Rilliard et al. we collected audio-visual expressions of attitudes such as arrogance, irony, sincerity and politeness in German. In the experimental design subjects are immersed in sixteen different communicative situations in which they are supposed to portray a certain attitude in a short dialog. Attitudes can be propositional, that is, reactions to a factual situation and/or social, that is, with respect to the relationship with the collocutor. Furthermore, attitudes can be of positive or negative valence or neutral. Undeniably there is a large repertory of subtle differences in the way certain talkers express certain attitudes. The important question is, however, whether collocutors either from the same language or a different one can actually decode these attitudes reliably. On that account we carried out three perceptual experiments in which we presented our recordings of the portrayed attitudes audiovisually, audio -only and video -only. In the first study, German perceivers rated the expressions given the intended attitude, in the second study, they had to choose the most suitable in a choice of five attitudes, and in the third study raters were able to assign freely the term best matching each attitudinal expression. This last experiment was recently replicated by native speakers of Cantonese in Hong Kong. The current article reviews and reevaluates the results from the first three experiments with the German subjects under the premise that perceivers actually have a more limited set of attitudinal registers which they can reliably draw on. This means that expressions can be sorted into a much smaller number of categories than the projected sixteen. In addition we compare and contrast these resulting clusters with the new data from the Cantonese speaking group. Our results indicate indeed a small number of readily decoded attitudes forming four clusters depending on the experiment design" - which are also distinct acoustically. Clusters from the statistical analysis are very similar for the German and the Cantonese perceivers and overlap with basic emotions. This result suggests that expressions of attitudes with low identification rates are more complex to decode and require more pragmatic information, that is, more contextual and possibly idiosyncratic information to be interpreted correctly. (C) 2017 Elsevier B.V. All rights reserved.
Stichworte
Social attitudes; Multi-modality; Speech perception; Speech production; Expressive speech; Prosodic analysis
Erscheinungsjahr
2017
Zeitschriftentitel
SPEECH COMMUNICATION
Band
95
Seite(n)
114-126
ISSN
0167-6393
eISSN
1872-7182
Page URI
https://pub.uni-bielefeld.de/record/2917177

Zitieren

Mixdorff H, Hönemann A, Rilliard A, Lee T, Ma MKH. Audio-visual expressions of attitude: How many different attitudes can perceivers decode? SPEECH COMMUNICATION. 2017;95:114-126.
Mixdorff, H., Hönemann, A., Rilliard, A., Lee, T., & Ma, M. K. H. (2017). Audio-visual expressions of attitude: How many different attitudes can perceivers decode? SPEECH COMMUNICATION, 95, 114-126. https://doi.org/10.1016/j.specom.2017.08.009
Mixdorff, Hansjoerg, Hönemann, Angelika, Rilliard, Albert, Lee, Tan, and Ma, Matthew K. H. 2017. “Audio-visual expressions of attitude: How many different attitudes can perceivers decode?”. SPEECH COMMUNICATION 95: 114-126.
Mixdorff, H., Hönemann, A., Rilliard, A., Lee, T., and Ma, M. K. H. (2017). Audio-visual expressions of attitude: How many different attitudes can perceivers decode? SPEECH COMMUNICATION 95, 114-126.
Mixdorff, H., et al., 2017. Audio-visual expressions of attitude: How many different attitudes can perceivers decode? SPEECH COMMUNICATION, 95, p 114-126.
H. Mixdorff, et al., “Audio-visual expressions of attitude: How many different attitudes can perceivers decode?”, SPEECH COMMUNICATION, vol. 95, 2017, pp. 114-126.
Mixdorff, H., Hönemann, A., Rilliard, A., Lee, T., Ma, M.K.H.: Audio-visual expressions of attitude: How many different attitudes can perceivers decode? SPEECH COMMUNICATION. 95, 114-126 (2017).
Mixdorff, Hansjoerg, Hönemann, Angelika, Rilliard, Albert, Lee, Tan, and Ma, Matthew K. H. “Audio-visual expressions of attitude: How many different attitudes can perceivers decode?”. SPEECH COMMUNICATION 95 (2017): 114-126.
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Suchen in

Google Scholar