Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies

Wagner P, Cwiek A, Samlowski B (2019)
Journal of Phonetics 76: UNSP 100911.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Wagner, PetraUniBi ; Cwiek, Alexandra; Samlowski, Barbara
Abstract / Bemerkung
In this paper, we explore the possibility to gather perceptual impressions of prosodic prominence by exploiting the strong prosody-gesture link, i.e., by having listeners transform a perceptual impression into a motor movement, namely drumming, for two domains of prominence: word-level and syllable-level. A feasibility study reveals that such a procedure is indeed easily and speedily mastered by naive listeners, but more difficult for word-level prominences. We furthermore examine whether drummed annotations are comparable to those gathered with more established annotation protocols based on cumulative naive impressions and fine-grained expert ratings. These comparisons reveal high correspondences across all prominence annotation protocols, thus corroborating the general usefulness of the gestural approach. The analyses also reveal that all annotation protocols are strongly driven by structural linguistic considerations. We then use Random Forest Models to investigate the relative impact of signal and structural cues to prominence annotations. We find that expert ratings of prosodic prominence are guided comparatively more by structural concerns than those of naive annotators, that word-level annotations are influenced more by structural linguistic cues than syllable-level ones, and that "drummed" annotations are driven least by structural cues. Lastly, we isolate two main listener strategies among our group of "drummers", namely those integrating structural and signal cues to prominence, and those being guided predominantly by signal cues. (C) 2019 Elsevier Ltd. All rights reserved.
Erscheinungsjahr
2019
Zeitschriftentitel
Journal of Phonetics
Band
76
Art.-Nr.
UNSP 100911
ISSN
0095-4470
Page URI
https://pub.uni-bielefeld.de/record/2921404

Zitieren

Wagner P, Cwiek A, Samlowski B. Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies. Journal of Phonetics. 2019;76: UNSP 100911.
Wagner, P., Cwiek, A., & Samlowski, B. (2019). Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies. Journal of Phonetics, 76, UNSP 100911. doi:10.1016/j.wocn.2019.07.001
Wagner, P., Cwiek, A., and Samlowski, B. (2019). Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies. Journal of Phonetics 76:UNSP 100911.
Wagner, P., Cwiek, A., & Samlowski, B., 2019. Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies. Journal of Phonetics, 76: UNSP 100911.
P. Wagner, A. Cwiek, and B. Samlowski, “Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies”, Journal of Phonetics, vol. 76, 2019, : UNSP 100911.
Wagner, P., Cwiek, A., Samlowski, B.: Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies. Journal of Phonetics. 76, : UNSP 100911 (2019).
Wagner, Petra, Cwiek, Alexandra, and Samlowski, Barbara. “Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies”. Journal of Phonetics 76 (2019): UNSP 100911.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

Suchen in

Google Scholar