Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study
Wang Y, Buschmeier H (2023)
In: Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore: 15372--15379.
Konferenzbeitrag
| Veröffentlicht | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Einrichtung
Abstract / Bemerkung
It is generally assumed that language (written and spoken) follows the entropy rate constancy (ERC) principle, which states that the information density of a text is constant over time. Recently, this has also been found for nonverbal gestures used in monologue, but it is still unclear whether the ERC principle also applies to listeners' nonverbal signals. We focus on listeners' gaze behaviour extracted from video-recorded conversations and trained a transformer-based neural sequence model to process the gaze data of the dialogues and compute its information density. We also compute the information density of the corresponding speech using a pre-trained language model. Our results show (1) that listeners' gaze behaviour in dialogues roughly follows the ERC principle, as well as (2) a congruence between information density of speech and listeners' gaze behaviour.
Stichworte
entropy rate constancy principle;
information density;
dialogue;
nonverbal behaviour;
gaze
Erscheinungsjahr
2023
Titel des Konferenzbandes
Findings of the Association for Computational Linguistics: EMNLP 2023
Seite(n)
15372--15379
Konferenz
The 2023 Conference on Empirical Methods in Natural Language Processing
Konferenzort
Singapore
Konferenzdatum
2023-12-06 – 2023-12-10
Page URI
https://pub.uni-bielefeld.de/record/2983825
Zitieren
Wang Y, Buschmeier H. Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. In: Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore; 2023: 15372--15379.
Wang, Y., & Buschmeier, H. (2023). Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. Findings of the Association for Computational Linguistics: EMNLP 2023, 15372--15379. Singapore.
Wang, Yu, and Buschmeier, Hendrik. 2023. “Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study”. In Findings of the Association for Computational Linguistics: EMNLP 2023, 15372--15379. Singapore.
Wang, Y., and Buschmeier, H. (2023). “Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study” in Findings of the Association for Computational Linguistics: EMNLP 2023 (Singapore), 15372--15379.
Wang, Y., & Buschmeier, H., 2023. Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. In Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore, pp. 15372--15379.
Y. Wang and H. Buschmeier, “Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study”, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore: 2023, pp.15372--15379.
Wang, Y., Buschmeier, H.: Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study. Findings of the Association for Computational Linguistics: EMNLP 2023. p. 15372--15379. Singapore (2023).
Wang, Yu, and Buschmeier, Hendrik. “Does listener gaze in face-to-face interaction follow the Entropy Rate Constancy principle: An empirical study”. Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore, 2023. 15372--15379.
Link(s) zu Volltext(en)
Access Level
Open Access