How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment

Holthaus P, Leichsenring C, Bernotat J, Richter V, Pohling M, Carlmeyer B, Köster N, Meyer zu Borgsen S, Zorn R, Schiffhauer B, Engelmann KF, et al. (2016)
In: Proceedings of the 10th Language Resources and Evaluation Conference. European Language Resources Association (ELRA): 3440-3446.

Download
OA 2.31 MB
Conference Paper | Published | English
Abstract
In order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is also inhabited by a social robot that is available as a humanoid interface. This paper presents a multi-modal corpus that contains goal-directed actions of naive users in attempts to solve a number of predefined tasks. Alongside audio and video recordings, our data-set consists of large amount of temporally aligned sensory data and system behavior provided by the environment and its interactive components. Non-verbal system responses such as changes in light or display contents, as well as robot and apartment utterances and gestures serve as a rich basis for later in-depth analysis. Manual annotations provide further information about meta data like the current course of study and user behavior including the incorporated modality, all literal utterances, language features, emotional expressions, foci of attention, and addressees.
Publishing Year
Conference
10th Language Resources and Evaluation Conference
Location
Portorož
Conference Date
2016-05-23 – 2016-05-28
PUB-ID

Cite this

Holthaus P, Leichsenring C, Bernotat J, et al. How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment. In: Proceedings of the 10th Language Resources and Evaluation Conference. European Language Resources Association (ELRA); 2016: 3440-3446.
Holthaus, P., Leichsenring, C., Bernotat, J., Richter, V., Pohling, M., Carlmeyer, B., Köster, N., et al. (2016). How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment. Proceedings of the 10th Language Resources and Evaluation Conference, 3440-3446. European Language Resources Association (ELRA).
Holthaus, P., Leichsenring, C., Bernotat, J., Richter, V., Pohling, M., Carlmeyer, B., Köster, N., Meyer zu Borgsen, S., Zorn, R., Schiffhauer, B., et al. (2016). “How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment” in Proceedings of the 10th Language Resources and Evaluation Conference (European Language Resources Association (ELRA), 3440-3446.
Holthaus, P., et al., 2016. How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment. In Proceedings of the 10th Language Resources and Evaluation Conference. European Language Resources Association (ELRA), pp. 3440-3446.
P. Holthaus, et al., “How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment”, Proceedings of the 10th Language Resources and Evaluation Conference, European Language Resources Association (ELRA), 2016, pp.3440-3446.
Holthaus, P., Leichsenring, C., Bernotat, J., Richter, V., Pohling, M., Carlmeyer, B., Köster, N., Meyer zu Borgsen, S., Zorn, R., Schiffhauer, B., Engelmann, K.F., Lier, F., Schulz, S., Cimiano, P., Eyssel, F.A., Hermann, T., Kummert, F., Schlangen, D., Wachsmuth, S., Wagner, P., Wrede, B., Wrede, S.: How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment. Proceedings of the 10th Language Resources and Evaluation Conference. p. 3440-3446. European Language Resources Association (ELRA) (2016).
Holthaus, Patrick, Leichsenring, Christian, Bernotat, Jasmin, Richter, Viktor, Pohling, Marian, Carlmeyer, Birte, Köster, Norman, Meyer zu Borgsen, Sebastian, Zorn, René, Schiffhauer, Birte, Engelmann, Kai Frederic, Lier, Florian, Schulz, Simon, Cimiano, Philipp, Eyssel, Friederike Anne, Hermann, Thomas, Kummert, Franz, Schlangen, David, Wachsmuth, Sven, Wagner, Petra, Wrede, Britta, and Wrede, Sebastian. “How to adress smart homes with a social robot? A multi-modal corpus of user interactions with an intelligent environment”. Proceedings of the 10th Language Resources and Evaluation Conference. European Language Resources Association (ELRA), 2016. 3440-3446.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Main File(s)
File Name
Access Level
OA Open Access
Last Uploaded
2017-07-14T08:32:22Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search