Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees
Richter V, Carlmeyer B, Lier F, Meyer zu Borgsen S, Schlangen D, Kummert F, Wachsmuth S, Wrede B (2016)
In: Proceedings of the Fourth International Conference on Human-agent Interaction. Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library.
Konferenzbeitrag
| Veröffentlicht | Englisch
Download
preprint.pdf
638.40 KB
Autor*in
Einrichtung
Abstract / Bemerkung
In this paper we present our humanoid robot “Meka”, partici- pating in a multi party human robot dialogue scenario. Active arbitration of the robot's attention based-on multi-modal stim- uli is utilised to attain persons which are outside of the robots field of view. We investigate the impact of this attention management and an addressee recognition on the robot's capability to distinguish utterances directed at it from communication between humans. Based on the results of a user study, we show that mutual gaze at the end of an utterance, as a means of yielding a turn, is a substantial cue for addressee recognition. Verification of a speaker through the detection of lip movements can be used to further increase precision. Further- more, we show that even a rather simplistic fusion of gaze and lip movement cues allows a considerable enhancement in addressee estimation, and can be altered to adapt to the requirements of a particular scenario.
Stichworte
CLF_RESEARCH_HIGHLIGHT
Erscheinungsjahr
2016
Titel des Konferenzbandes
Proceedings of the Fourth International Conference on Human-agent Interaction
Serien- oder Zeitschriftentitel
Proceedings of the Fourth International Conference on Human-agent Interaction
Urheberrecht / Lizenzen
Konferenz
4th Internation Conference on Human Agent Interaction
Konferenzort
Singapore
Konferenzdatum
2016-10-04 – 2016-10-07
Page URI
https://pub.uni-bielefeld.de/record/2904611
Zitieren
Richter V, Carlmeyer B, Lier F, et al. Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees. In: Proceedings of the Fourth International Conference on Human-agent Interaction. Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library; 2016.
Richter, V., Carlmeyer, B., Lier, F., Meyer zu Borgsen, S., Schlangen, D., Kummert, F., Wachsmuth, S., et al. (2016). Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees. Proceedings of the Fourth International Conference on Human-agent Interaction, Proceedings of the Fourth International Conference on Human-agent Interaction Singapore: ACM Digital Library. https://doi.org/10.1145/2974804.2974823
Richter, Viktor, Carlmeyer, Birte, Lier, Florian, Meyer zu Borgsen, Sebastian, Schlangen, David, Kummert, Franz, Wachsmuth, Sven, and Wrede, Britta. 2016. “Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees”. In Proceedings of the Fourth International Conference on Human-agent Interaction. Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library.
Richter, V., Carlmeyer, B., Lier, F., Meyer zu Borgsen, S., Schlangen, D., Kummert, F., Wachsmuth, S., and Wrede, B. (2016). “Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees” in Proceedings of the Fourth International Conference on Human-agent Interaction Proceedings of the Fourth International Conference on Human-agent Interaction (Singapore: ACM Digital Library).
Richter, V., et al., 2016. Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees. In Proceedings of the Fourth International Conference on Human-agent Interaction. Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library.
V. Richter, et al., “Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees”, Proceedings of the Fourth International Conference on Human-agent Interaction, Proceedings of the Fourth International Conference on Human-agent Interaction, Singapore: ACM Digital Library, 2016.
Richter, V., Carlmeyer, B., Lier, F., Meyer zu Borgsen, S., Schlangen, D., Kummert, F., Wachsmuth, S., Wrede, B.: Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees. Proceedings of the Fourth International Conference on Human-agent Interaction. Proceedings of the Fourth International Conference on Human-agent Interaction. ACM Digital Library, Singapore (2016).
Richter, Viktor, Carlmeyer, Birte, Lier, Florian, Meyer zu Borgsen, Sebastian, Schlangen, David, Kummert, Franz, Wachsmuth, Sven, and Wrede, Britta. “Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees”. Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library, 2016. Proceedings of the Fourth International Conference on Human-agent Interaction.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Name
preprint.pdf
638.40 KB
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-25T06:39:50Z
MD5 Prüfsumme
925f80825c8b264e79834bf9162de300
Google Scholar