EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study
Richter B, Putze F, Ivucic G, Brandt M, Schütze C, Reisenhofer R, Wrede B, Schultz T (2023)
Multimodal Technologies and Interaction 7(4): 37.
Zeitschriftenaufsatz
| Veröffentlicht | Englisch
Download
mti-07-00037.pdf
3.59 MB
Autor*in
Richter, BirteUniBi ;
Putze, Felix;
Ivucic, Gabriel;
Brandt, MaraUniBi ;
Schütze, ChristianUniBi ;
Reisenhofer, Rafael;
Wrede, Britta;
Schultz, Tanja
Einrichtung
SFB/Transregio 318 Constructing Explainability > Projektbereich A: Erklären > Teilprojekt A05: Echtzeitmessung der Aufmerksamkeit im Mensch-Roboter-Erklärdialog
SFB/Transregio 318 Constructing Explainability > Projektbereich A: Erklären > Teilprojekt A03: Ko-Konstruktion von Erklärungen mit emotionaler Ausrichtung zwischen KI-Erklärer*in und menschlichen Erklärungsempfänger*innen
Center of Excellence - Cognitive Interaction Technology CITEC >AG2 Medizinische Assistenzsysteme
Medizinische Fakultät OWL > AG 2 Medizinische Assistenzsysteme
SFB/Transregio 318 Constructing Explainability > Projektbereich A: Erklären > Teilprojekt A03: Ko-Konstruktion von Erklärungen mit emotionaler Ausrichtung zwischen KI-Erklärer*in und menschlichen Erklärungsempfänger*innen
Center of Excellence - Cognitive Interaction Technology CITEC >AG2 Medizinische Assistenzsysteme
Medizinische Fakultät OWL > AG 2 Medizinische Assistenzsysteme
Abstract / Bemerkung
In this paper, we investigate the effect of distractions and hesitations as a scaffolding strategy. Recent research points to the potential beneficial effects of a speaker’s hesitations on the listeners’ comprehension of utterances, although results from studies on this issue indicate that humans do not make strategic use of them. The role of hesitations and their communicative function in human-human interaction is a much-discussed topic in current research. To better understand the underlying cognitive processes, we developed a human–robot interaction (HRI) setup that allows the measurement of the electroencephalogram (EEG) signals of a human participant while interacting with a robot. We thereby address the research question of whether we find effects on single-trial EEG based on the distraction and the corresponding robot’s hesitation scaffolding strategy. To carry out the experiments, we leverage our LabLinking method, which enables interdisciplinary joint research between remote labs. This study could not have been conducted without LabLinking, as the two involved labs needed to combine their individual expertise and equipment to achieve the goal together. The results of our study indicate that the EEG correlates in the distracted condition are different from the baseline condition without distractions. Furthermore, we could differentiate the EEG correlates of distraction with and without a hesitation scaffolding strategy. This proof-of-concept study shows that LabLinking makes it possible to conduct collaborative HRI studies in remote laboratories and lays the first foundation for more in-depth research into robotic scaffolding strategies.
Stichworte
human–robot interaction;
LabLinking;
electroencephalography;
neural correlates of distraction;
role of hesitations in spoken communication
Erscheinungsjahr
2023
Zeitschriftentitel
Multimodal Technologies and Interaction
Band
7
Ausgabe
4
Art.-Nr.
37
Urheberrecht / Lizenzen
eISSN
2414-4088
Finanzierungs-Informationen
Open-Access-Publikationskosten wurden durch die Universität Bielefeld gefördert.
Page URI
https://pub.uni-bielefeld.de/record/2977905
Zitieren
Richter B, Putze F, Ivucic G, et al. EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study. Multimodal Technologies and Interaction. 2023;7(4): 37.
Richter, B., Putze, F., Ivucic, G., Brandt, M., Schütze, C., Reisenhofer, R., Wrede, B., et al. (2023). EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study. Multimodal Technologies and Interaction, 7(4), 37. https://doi.org/10.3390/mti7040037
Richter, Birte, Putze, Felix, Ivucic, Gabriel, Brandt, Mara, Schütze, Christian, Reisenhofer, Rafael, Wrede, Britta, and Schultz, Tanja. 2023. “EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study”. Multimodal Technologies and Interaction 7 (4): 37.
Richter, B., Putze, F., Ivucic, G., Brandt, M., Schütze, C., Reisenhofer, R., Wrede, B., and Schultz, T. (2023). EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study. Multimodal Technologies and Interaction 7:37.
Richter, B., et al., 2023. EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study. Multimodal Technologies and Interaction, 7(4): 37.
B. Richter, et al., “EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study”, Multimodal Technologies and Interaction, vol. 7, 2023, : 37.
Richter, B., Putze, F., Ivucic, G., Brandt, M., Schütze, C., Reisenhofer, R., Wrede, B., Schultz, T.: EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study. Multimodal Technologies and Interaction. 7, : 37 (2023).
Richter, Birte, Putze, Felix, Ivucic, Gabriel, Brandt, Mara, Schütze, Christian, Reisenhofer, Rafael, Wrede, Britta, and Schultz, Tanja. “EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study”. Multimodal Technologies and Interaction 7.4 (2023): 37.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Name
mti-07-00037.pdf
3.59 MB
Access Level
Open Access
Zuletzt Hochgeladen
2023-03-29T11:06:05Z
MD5 Prüfsumme
6f04b42f2077049db479ff28b34ebbe0
Link(s) zu Volltext(en)
Access Level
Open Access
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Suchen in