Hand-Object Interaction Detection with Fully Convolutional Networks

Schröder M, Ritter H (2017)
In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 18-25.

Download
OA 3.25 MB
Conference Paper | Published | English
Abstract
Detecting hand-object interactions is a challenging problem with many applications in the human-computer interaction domain. We present a real-time method that automatically detects hand-object interactions in RGBD sensor data and tracks the object’s rigid pose over time. The detection is performed using a fully convolutional neural network, which is purposefully trained to discern the relationship between hands and objects and which predicts pixel-wise class probabilities. This output is used in a probabilistic pixel labeling strategy that explicitly accounts for the uncertainty of the prediction. Based on the labeling of object pixels, the object is tracked over time using modelbased registration. We evaluate the accuracy and generalizability of our approach and make our annotated RGBD dataset as well as our trained models publicly available.
Publishing Year
Conference
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (ODAR)
Location
Honolulu, HI, USA
Conference Date
2017-07-21 – 2017-07-26
PUB-ID

Cite this

Schröder M, Ritter H. Hand-Object Interaction Detection with Fully Convolutional Networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 2017: 18-25.
Schröder, M., & Ritter, H. (2017). Hand-Object Interaction Detection with Fully Convolutional Networks. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 18-25.
Schröder, M., and Ritter, H. (2017). “Hand-Object Interaction Detection with Fully Convolutional Networks” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 18-25.
Schröder, M., & Ritter, H., 2017. Hand-Object Interaction Detection with Fully Convolutional Networks. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. pp. 18-25.
M. Schröder and H. Ritter, “Hand-Object Interaction Detection with Fully Convolutional Networks”, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2017, pp.18-25.
Schröder, M., Ritter, H.: Hand-Object Interaction Detection with Fully Convolutional Networks. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. p. 18-25. (2017).
Schröder, Matthias, and Ritter, Helge. “Hand-Object Interaction Detection with Fully Convolutional Networks”. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 2017. 18-25.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Main File(s)
File Name
paper.pdf 3.25 MB
Access Level
OA Open Access
Last Uploaded
2017-08-14T08:47:15Z

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar