Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research

Lier F, Lücking P, de Leeuw J, Wachsmuth S, Šabanović S, Goldstone R (2017)
In: ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead. Bonsignorio FP (Ed); Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore. IEEE.

Download
OA
Conference Abstract | Published | English
Author
; ; ; ; ;
Editor
Bonsignorio, Fabio P.
Publishing Year
Conference
IEEE International Conference on Robotics and Automation (ICRA) 2017
Location
Singapore
Conference Date
2017-05-29 – 2017-06-04
PUB-ID

Cite this

Lier F, Lücking P, de Leeuw J, Wachsmuth S, Šabanović S, Goldstone R. Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research. In: Bonsignorio FP, ed. ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore. IEEE; 2017.
Lier, F., Lücking, P., de Leeuw, J., Wachsmuth, S., Šabanović, S., & Goldstone, R. (2017). Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research. In F. P. Bonsignorio (Ed.), Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore. ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead IEEE.
Lier, F., Lücking, P., de Leeuw, J., Wachsmuth, S., Šabanović, S., and Goldstone, R. (2017). “Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research” in ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead, Bonsignorio, F. P. ed. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore (IEEE).
Lier, F., et al., 2017. Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research. In F. P. Bonsignorio, ed. ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore. IEEE.
F. Lier, et al., “Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research”, ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead, F.P. Bonsignorio, ed., Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore, IEEE, 2017.
Lier, F., Lücking, P., de Leeuw, J., Wachsmuth, S., Šabanović, S., Goldstone, R.: Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research. In: Bonsignorio, F.P. (ed.) ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore. IEEE (2017).
Lier, Florian, Lücking, Phillip, de Leeuw, Joshua, Wachsmuth, Sven, Šabanović, Selma, and Goldstone, Robert. “Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research”. ICRA 2017 Workshop on Reproducible Research in Robotics: Current Status and Road Ahead. Ed. Fabio P. Bonsignorio. IEEE, 2017. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), IEEE Xplore.
All files available under the following license(s):
Creative Commons License:
CC0
Creative Commons Public Domain Dedication (CC0 1.0)
Main File(s)
File Title
Can we Reproduce it? Toward the Implementation of good Experimental Methodology in Interdisciplinary Robotics Research
Description
The insufficient level of reproducibility of pub- lished experimental results has been identified as a core issue in the field of robotics in recent years. Why is that? First of all, robotics focuses on the abstract concept of computation and the creation of technological artifacts, i.e., software that implements these concepts. Hence, before actually reproducing an experiment, the subject of investigation must be artificially created, which is non-trivial given the inherent complexity [5]. Second, robotics experiments usually include expensive and often customized hardware setups (robots), that are difficult to operate for non-experts. Finally, there is no agreed upon set of methods in order to setup, execute, or (re-)conduct an experiment. To this end, we introduce an interdisciplinary and geograph- ically distributed collaboration project that aims at implement- ing good experimental methodology in interdisciplinary robotics research with respect to: a) reproducibility of required technical artifacts, b) explicit and comprehensible experiment design, c) repeatable/reproducible experiment execution, and d) repro- ducible evaluation of obtained experiment data. The ultimate goal of this collaboration is to reproduce the same experiment in two different laboratories using the same systematic approach which is presented in this work.
Access Level
OA Open Access
Last Uploaded
2017-08-07T08:39:09Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar