Talking with Robots about Objects: A system-level evaluation in HRI

Peltason J, Riether N, Wrede B, Lütkebohle I (2012)
In: 7th ACM/IEEE Conference on Human-Robot-Interaction. .

Conference Paper | Published | English

No fulltext has been uploaded

Abstract
We present the design process, realization and evaluation of a robot system for interactive object learning. The system-oriented evaluation, in particular, addresses an open problem for the evaluation of systems, where overall user satisfcation depends not only on the performance of the parts, but also on their combination, and on user behavior. Based on the PARADISE method known from spoken dialog systems, we have defined and applied internal and external metrics for fine-grained and largely automatable identification of such relationships. Through evaluation with n=28 subjects, indicator functions explaining up to 55% of variation in several satisfaction metrics were found. Furthermore, we demonstrate that the system’s interaction style reduces the need for instruction and successfully recovers partial failures.
Publishing Year
Conference
7th ACM/IEEE International Conference on Human-Robot-Interaction
Location
Boston, Massachusetts, USA
Conference Date
2012-03-05
PUB-ID

Cite this

Peltason J, Riether N, Wrede B, Lütkebohle I. Talking with Robots about Objects: A system-level evaluation in HRI. In: 7th ACM/IEEE Conference on Human-Robot-Interaction. 2012.
Peltason, J., Riether, N., Wrede, B., & Lütkebohle, I. (2012). Talking with Robots about Objects: A system-level evaluation in HRI. 7th ACM/IEEE Conference on Human-Robot-Interaction.
Peltason, J., Riether, N., Wrede, B., and Lütkebohle, I. (2012). “Talking with Robots about Objects: A system-level evaluation in HRI” in 7th ACM/IEEE Conference on Human-Robot-Interaction.
Peltason, J., et al., 2012. Talking with Robots about Objects: A system-level evaluation in HRI. In 7th ACM/IEEE Conference on Human-Robot-Interaction.
J. Peltason, et al., “Talking with Robots about Objects: A system-level evaluation in HRI”, 7th ACM/IEEE Conference on Human-Robot-Interaction, 2012.
Peltason, J., Riether, N., Wrede, B., Lütkebohle, I.: Talking with Robots about Objects: A system-level evaluation in HRI. 7th ACM/IEEE Conference on Human-Robot-Interaction. (2012).
Peltason, Julia, Riether, Nina, Wrede, Britta, and Lütkebohle, Ingo. “Talking with Robots about Objects: A system-level evaluation in HRI”. 7th ACM/IEEE Conference on Human-Robot-Interaction. 2012.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar