The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset

Jayagopi D, Sheikhi S, Klotz D, Wienke J, Jean-Marc O, Wrede S, Khalidov V, Nguyen L, Wrede B, Gatica-Perez D (2013)
In: Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. Kuzuoka H, Evers V, Imai M, Forlizzi J (Eds);IEEE.

Conference Paper | Published | English

No fulltext has been uploaded

Author
; ; ; ; ; ; ; ; ;
Editor
Kuzuoka, Hideaki ; Evers, Vanessa ; Imai, Michita ; Forlizzi, Jodi
Abstract
We introduce a new conversational Human-Robot-Interaction (HRI) dataset with a real-behaving robot inducing interactive behavior with and between humans. Our scenario involves a humanoid robot NAO1 explaining paintings in a room and then quizzing the participants, who are naive users. As perceiving nonverbal cues, apart from the spoken words, plays a major role in social interactions and socially-interactive robots, we have extensively annotated the dataset. It has been recorded and annotated to benchmark many relevant perceptual tasks, towards enabling a robot to converse with multiple humans, such as speaker localization and speech segmentation; tracking, pose estimation, nodding, visual focus of attention estimation in visual domain; and an audio-visual task such as addressee detection. NAO system states are also available. As compared to recordings done with a static camera, this corpus involves the head-movement of a humanoid robot (due to gaze change, nodding), posing challenges to visual processing. Also, the significant background noise present in a real HRI setting makes auditory tasks challenging.
Publishing Year
Conference
8th ACM/IEEE International Conference on Human-Robot Interaction
Location
Tokyo, Japan
Conference Date
2013-03-03 – 2013-03-06
PUB-ID

Cite this

Jayagopi D, Sheikhi S, Klotz D, et al. The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset. In: Kuzuoka H, Evers V, Imai M, Forlizzi J, eds. Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. IEEE; 2013.
Jayagopi, D., Sheikhi, S., Klotz, D., Wienke, J., Jean-Marc, O., Wrede, S., Khalidov, V., et al. (2013). The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset. In H. Kuzuoka, V. Evers, M. Imai, & J. Forlizzi (Eds.), Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction IEEE.
Jayagopi, D., Sheikhi, S., Klotz, D., Wienke, J., Jean-Marc, O., Wrede, S., Khalidov, V., Nguyen, L., Wrede, B., and Gatica-Perez, D. (2013). “The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset” in Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction, Kuzuoka, H., Evers, V., Imai, M., and Forlizzi, J. eds. (IEEE).
Jayagopi, D., et al., 2013. The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset. In H. Kuzuoka, et al., eds. Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. IEEE.
D. Jayagopi, et al., “The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset”, Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction, H. Kuzuoka, et al., eds., IEEE, 2013.
Jayagopi, D., Sheikhi, S., Klotz, D., Wienke, J., Jean-Marc, O., Wrede, S., Khalidov, V., Nguyen, L., Wrede, B., Gatica-Perez, D.: The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset. In: Kuzuoka, H., Evers, V., Imai, M., and Forlizzi, J. (eds.) Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. IEEE (2013).
Jayagopi, Dinesh, Sheikhi, Samira, Klotz, David, Wienke, Johannes, Jean-Marc, Odobez, Wrede, Sebastian, Khalidov, Vasil, Nguyen, L., Wrede, Britta, and Gatica-Perez, Daniel. “The Vernissage Corpus: A Conversational Human-Robot Interaction Dataset”. Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. Ed. Hideaki Kuzuoka, Vanessa Evers, Michita Imai, and Jodi Forlizzi. IEEE, 2013.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search