Generation and evaluation of communicative robot gesture

Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F (2012)
International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4(2): 201-217.

Download
OA
Journal Article | Published | English
Abstract
How is communicative gesture behavior in robots perceived by humans? Although gesture is crucial in social interaction, this research question is still largely unexplored in the field of social robotics. Thus, the main objective of the present work is to investigate how gestural machine behaviors can be used to design more natural communication in social robots. The chosen approach is twofold. Firstly, the technical challenges encountered when implementing a speech-gesture generation model on a robotic platform are tackled. We present a framework that enables the humanoid robot to flexibly produce synthetic speech and co-verbal hand and arm gestures at run-time, while not being limited to a predefined repertoire of motor actions. Secondly, the achieved flexibility in robot gesture is exploited in controlled experiments. To gain a deeper understanding of how communicative robot gesture might impact and shape human perception and evaluation of human-robot interaction, we conducted a between-subjects experimental study using the humanoid robot in a joint task scenario. We manipulated the non-verbal behaviors of the robot in three experimental conditions, so that it would refer to objects by utilizing either (1) unimodal (i.e., speech only) utterances, (2) congruent multimodal (i.e., semantically matching speech and gesture) or (3) incongruent multimodal (i.e., semantically non-matching speech and gesture) utterances. Our findings reveal that the robot is evaluated more positively when non-verbal behaviors such as hand and arm gestures are displayed along with speech, even if they do not semantically match the spoken utterance.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F. Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions. 2012;4(2):201-217.
Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., & Joublin, F. (2012). Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions, 4(2), 201-217.
Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., and Joublin, F. (2012). Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4, 201-217.
Salem, M., et al., 2012. Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions, 4(2), p 201-217.
M. Salem, et al., “Generation and evaluation of communicative robot gesture”, International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions, vol. 4, 2012, pp. 201-217.
Salem, M., Kopp, S., Wachsmuth, I., Rohlfing, K., Joublin, F.: Generation and evaluation of communicative robot gesture. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions. 4, 201-217 (2012).
Salem, Maha, Kopp, Stefan, Wachsmuth, Ipke, Rohlfing, Katharina, and Joublin, Frank. “Generation and evaluation of communicative robot gesture”. International Journal of Social Robotics, Special Issue on Expectations, Intentions, and Actions 4.2 (2012): 201-217.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2016-03-09T09:31:53Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar