Towards Automated System and Experiment Reproduction in Robotics

Lier F, Hanheide M, Natale L, Schulz S, Weisz J, Wachsmuth S, Wrede S (In Press)
In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Burgard W (Ed); International Conference on Intelligent Robots and Systems (IROS), . Daejeon, Korea: IEEE.

Download
OA 4.39 MB
Conference Paper | In Press | English
Author
; ; ; ; ; ;
Editor
Burgard, Wolfram
Abstract
Even though research on autonomous robots and human-robot interaction accomplished great progress in recent years, and reusable soft- and hardware components are available, many of the reported findings are only hardly reproducible by fellow scientists. Usually, reproducibility is impeded because required information, such as the specification of software versions and their configuration, required data sets, and experiment protocols are not mentioned or referenced in most publications. In order to address these issues, we recently introduced an integrated tool chain and its underlying development process to facilitate reproducibility in robotics. In this contribution we instantiate the complete tool chain in a unique user study in order to assess its applicability and usability. To this end, we chose three different robotic systems from independent institutions and modeled them in our tool chain, including three exemplary experiments. Subsequently, we asked twelve researchers to reproduce one of the formerly unknown systems and the associated experiment. We show that all twelve scientists were able to replicate a formerly unknown robotics experiment using our tool chain.
Publishing Year
Conference
International Conference on Intelligent Robots and Systems (IROS)
Location
Daejeon, Korea
Conference Date
2016-10-09 – 2016-10-14
PUB-ID

Cite this

Lier F, Hanheide M, Natale L, et al. Towards Automated System and Experiment Reproduction in Robotics. In: Burgard W, ed. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). International Conference on Intelligent Robots and Systems (IROS). Daejeon, Korea: IEEE; In Press.
Lier, F., Hanheide, M., Natale, L., Schulz, S., Weisz, J., Wachsmuth, S., & Wrede, S. (In Press). Towards Automated System and Experiment Reproduction in Robotics. In W. Burgard (Ed.), International Conference on Intelligent Robots and Systems (IROS). 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Daejeon, Korea: IEEE.
Lier, F., Hanheide, M., Natale, L., Schulz, S., Weisz, J., Wachsmuth, S., and Wrede, S. (In Press). “Towards Automated System and Experiment Reproduction in Robotics” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Burgard, W. ed. International Conference on Intelligent Robots and Systems (IROS) (Daejeon, Korea: IEEE).
Lier, F., et al., In Press. Towards Automated System and Experiment Reproduction in Robotics. In W. Burgard, ed. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). International Conference on Intelligent Robots and Systems (IROS). Daejeon, Korea: IEEE.
F. Lier, et al., “Towards Automated System and Experiment Reproduction in Robotics”, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), W. Burgard, ed., International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea: IEEE, In Press.
Lier, F., Hanheide, M., Natale, L., Schulz, S., Weisz, J., Wachsmuth, S., Wrede, S.: Towards Automated System and Experiment Reproduction in Robotics. In: Burgard, W. (ed.) 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). International Conference on Intelligent Robots and Systems (IROS). IEEE, Daejeon, Korea (In Press).
Lier, Florian, Hanheide, Marc, Natale, Lorenzo, Schulz, Simon, Weisz, Jonathan, Wachsmuth, Sven, and Wrede, Sebastian. “Towards Automated System and Experiment Reproduction in Robotics”. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Ed. Wolfram Burgard. Daejeon, Korea: IEEE, In Press. International Conference on Intelligent Robots and Systems (IROS).
Main File(s)
File Name
Access Level
OA Open Access
Last Uploaded
2016-10-04T10:52:34Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar