Estimating object proper motion using optical flow, kinematics, and depth information
Schmüdderich J, Willert V, Eggert J, Rebhan S, Goerick C, Sagerer G, Körner E (2008)
IEEE Trans Syst Man Cybern B Cybern 38(4): 1139-1151.
Zeitschriftenaufsatz
| Veröffentlicht | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Schmüdderich, Jens;
Willert, Volker;
Eggert, Julian;
Rebhan, Sven;
Goerick, Christian;
Sagerer, GerhardUniBi;
Körner, Edgar
Einrichtung
Abstract / Bemerkung
For the interaction of a mobile robot with a dynamic environment, the estimation of object motion is desired while the robot is walking and/or turning its head. In this paper, we describe a system which manages this task by combining depth from a stereo camera and computation of the camera movement from robot kinematics in order to stabilize the camera images. Moving objects are detected by applying optical flow to the stabilized images followed by a filtering method, which incorporates both prior knowledge about the accuracy of the measurement and the uncertainties of the measurement process itself. The efficiency of this system is demonstrated in a dynamic real-world scenario with a walking humanoid robot.
Stichworte
egomotion (EM);
disparity;
kinematics;
optical flow (OF);
motion
Erscheinungsjahr
2008
Zeitschriftentitel
IEEE Trans Syst Man Cybern B Cybern
Band
38
Ausgabe
4
Seite(n)
1139-1151
ISSN
1083-4419
eISSN
1941-0492
Page URI
https://pub.uni-bielefeld.de/record/1992020
Zitieren
Schmüdderich J, Willert V, Eggert J, et al. Estimating object proper motion using optical flow, kinematics, and depth information. IEEE Trans Syst Man Cybern B Cybern. 2008;38(4):1139-1151.
Schmüdderich, J., Willert, V., Eggert, J., Rebhan, S., Goerick, C., Sagerer, G., & Körner, E. (2008). Estimating object proper motion using optical flow, kinematics, and depth information. IEEE Trans Syst Man Cybern B Cybern, 38(4), 1139-1151. https://doi.org/10.1109/TSMCB.2008.925657
Schmüdderich, Jens, Willert, Volker, Eggert, Julian, Rebhan, Sven, Goerick, Christian, Sagerer, Gerhard, and Körner, Edgar. 2008. “Estimating object proper motion using optical flow, kinematics, and depth information”. IEEE Trans Syst Man Cybern B Cybern 38 (4): 1139-1151.
Schmüdderich, J., Willert, V., Eggert, J., Rebhan, S., Goerick, C., Sagerer, G., and Körner, E. (2008). Estimating object proper motion using optical flow, kinematics, and depth information. IEEE Trans Syst Man Cybern B Cybern 38, 1139-1151.
Schmüdderich, J., et al., 2008. Estimating object proper motion using optical flow, kinematics, and depth information. IEEE Trans Syst Man Cybern B Cybern, 38(4), p 1139-1151.
J. Schmüdderich, et al., “Estimating object proper motion using optical flow, kinematics, and depth information”, IEEE Trans Syst Man Cybern B Cybern, vol. 38, 2008, pp. 1139-1151.
Schmüdderich, J., Willert, V., Eggert, J., Rebhan, S., Goerick, C., Sagerer, G., Körner, E.: Estimating object proper motion using optical flow, kinematics, and depth information. IEEE Trans Syst Man Cybern B Cybern. 38, 1139-1151 (2008).
Schmüdderich, Jens, Willert, Volker, Eggert, Julian, Rebhan, Sven, Goerick, Christian, Sagerer, Gerhard, and Körner, Edgar. “Estimating object proper motion using optical flow, kinematics, and depth information”. IEEE Trans Syst Man Cybern B Cybern 38.4 (2008): 1139-1151.
Daten bereitgestellt von European Bioinformatics Institute (EBI)
4 Zitationen in Europe PMC
Daten bereitgestellt von Europe PubMed Central.
PageRank tracker: from ranking to tracking.
Gong C, Fu K, Loza A, Wu Q, Liu J, Yang J., IEEE Trans Cybern 44(6), 2014
PMID: 23963263
Gong C, Fu K, Loza A, Wu Q, Liu J, Yang J., IEEE Trans Cybern 44(6), 2014
PMID: 23963263
Three-dimensional motion estimation via matrix completion.
Li K, Dai Q, Xu W, Yang J, Jiang J., IEEE Trans Syst Man Cybern B Cybern 42(2), 2012
PMID: 22010156
Li K, Dai Q, Xu W, Yang J, Jiang J., IEEE Trans Syst Man Cybern B Cybern 42(2), 2012
PMID: 22010156
Kinematic Bézier Maps.
Ulbrich S, de Angulo VR, Asfour T, Torras C, Dillmann R., IEEE Trans Syst Man Cybern B Cybern 42(4), 2012
PMID: 22481828
Ulbrich S, de Angulo VR, Asfour T, Torras C, Dillmann R., IEEE Trans Syst Man Cybern B Cybern 42(4), 2012
PMID: 22481828
Action selection for single-camera SLAM.
Vidal-Calleja TA, Sanfeliu A, Andrade-Cetto J., IEEE Trans Syst Man Cybern B Cybern 40(6), 2010
PMID: 20350845
Vidal-Calleja TA, Sanfeliu A, Andrade-Cetto J., IEEE Trans Syst Man Cybern B Cybern 40(6), 2010
PMID: 20350845
34 References
Daten bereitgestellt von Europe PubMed Central.
Non-Gaussian velocity distributions integrated over space, time, and scales.
Willert V, Eggert J, Adamy J, Korner E., IEEE Trans Syst Man Cybern B Cybern 36(3), 2006
PMID: 16761804
Willert V, Eggert J, Adamy J, Korner E., IEEE Trans Syst Man Cybern B Cybern 36(3), 2006
PMID: 16761804
jhne, Digital Image Processing (), 2005
small vision system: hardware and implementation
konolige, Proc 8th Int Symp Robot Res (), 1997
konolige, Proc 8th Int Symp Robot Res (), 1997
craig, Introduction to Robotics Mechanics and Control (), 1989
honda, The Honda Humanoid Robots (), 2001
fidelman, Detecting motion in the world with a moving quadruped robot (), 2005
stereo vision motion detection from a moving platform
overett, Proc Australas Conf Robot Autom (), 2004
overett, Proc Australas Conf Robot Autom (), 2004
AUTHOR UNKNOWN, 0
fast detection of moving objects in complex scenarios
rabe, Proc IEEE Symp Intell Veh (), 2007
rabe, Proc IEEE Symp Intell Veh (), 2007
Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity.
Maunsell JH, Van Essen DC., J. Neurophysiol. 49(5), 1983
PMID: 6864243
Maunsell JH, Van Essen DC., J. Neurophysiol. 49(5), 1983
PMID: 6864243
Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey.
Tanaka K, Hikosaka K, Saito H, Yukie M, Fukada Y, Iwai E., J. Neurosci. 6(1), 1986
PMID: 3944614
Tanaka K, Hikosaka K, Saito H, Yukie M, Fukada Y, Iwai E., J. Neurosci. 6(1), 1986
PMID: 3944614
Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey.
Tanaka K, Fukada Y, Saito HA., J. Neurophysiol. 62(3), 1989
PMID: 2769352
Tanaka K, Fukada Y, Saito HA., J. Neurophysiol. 62(3), 1989
PMID: 2769352
Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli.
Duffy CJ, Wurtz RH., J. Neurophysiol. 65(6), 1991
PMID: 1875243
Duffy CJ, Wurtz RH., J. Neurophysiol. 65(6), 1991
PMID: 1875243
Response of monkey MST neurons to optic flow stimuli with shifted centers of motion.
Duffy CJ, Wurtz RH., J. Neurosci. 15(7 Pt 2), 1995
PMID: 7623145
Duffy CJ, Wurtz RH., J. Neurosci. 15(7 Pt 2), 1995
PMID: 7623145
The role of disparity-sensitive cortical neurons in signalling the direction of self-motion.
Roy JP, Wurtz RH., Nature 348(6297), 1990
PMID: 2234078
Roy JP, Wurtz RH., Nature 348(6297), 1990
PMID: 2234078
faugeras, Three-Dimensional Computer Vision A Geometric Viewpoint (), 1999
AUTHOR UNKNOWN, 0
Eye position encoding in the macaque posterior parietal cortex.
Bremmer F, Pouget A, Hoffmann KP., Eur. J. Neurosci. 10(1), 1998
PMID: 9753122
Bremmer F, Pouget A, Hoffmann KP., Eur. J. Neurosci. 10(1), 1998
PMID: 9753122
albright, Visual Motion and its Use in the Stabilization of Gaze (), 1993
AUTHOR UNKNOWN, 0
AUTHOR UNKNOWN, 0
AUTHOR UNKNOWN, 0
AUTHOR UNKNOWN, Real-Time Obstacle Detection With a Calibrated Camera and Known Ego-Motion (), 2004
AUTHOR UNKNOWN, 0
Optic flow is used to control human walking.
Warren WH Jr, Kay BA, Zosh WD, Duchon AP, Sahuc S., Nat. Neurosci. 4(2), 2001
PMID: 11175884
Warren WH Jr, Kay BA, Zosh WD, Duchon AP, Sahuc S., Nat. Neurosci. 4(2), 2001
PMID: 11175884
del, RoboCup 2004 Robot Soccer World Cup VIII 3276(), 2005
What attributes guide the deployment of visual attention and how do they do it?
Wolfe JM, Horowitz TS., Nat. Rev. Neurosci. 5(6), 2004
PMID: 15152199
Wolfe JM, Horowitz TS., Nat. Rev. Neurosci. 5(6), 2004
PMID: 15152199
Visual and non-visual cues in the perception of linear self-motion.
Harris LR, Jenkin M, Zikovitz DC., Exp Brain Res 135(1), 2000
PMID: 11104123
Harris LR, Jenkin M, Zikovitz DC., Exp Brain Res 135(1), 2000
PMID: 11104123
Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area.
Fetsch CR, Wang S, Gu Y, Deangelis GC, Angelaki DE., J. Neurosci. 27(3), 2007
PMID: 17234602
Fetsch CR, Wang S, Gu Y, Deangelis GC, Angelaki DE., J. Neurosci. 27(3), 2007
PMID: 17234602
Visual and nonvisual contributions to three-dimensional heading selectivity in the medial superior temporal area.
Gu Y, Watkins PV, Angelaki DE, DeAngelis GC., J. Neurosci. 26(1), 2006
PMID: 16399674
Gu Y, Watkins PV, Angelaki DE, DeAngelis GC., J. Neurosci. 26(1), 2006
PMID: 16399674
Linear vestibular self-motion signals in monkey medial superior temporal area.
Bremmer F, Kubischik M, Pekel M, Lappe M, Hoffmann KP., Ann. N. Y. Acad. Sci. 871(), 1999
PMID: 10372078
Bremmer F, Kubischik M, Pekel M, Lappe M, Hoffmann KP., Ann. N. Y. Acad. Sci. 871(), 1999
PMID: 10372078
MST neurons respond to optic flow and translational movement.
Duffy CJ., J. Neurophysiol. 80(4), 1998
PMID: 9772241
Duffy CJ., J. Neurophysiol. 80(4), 1998
PMID: 9772241
Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons.
Komatsu H, Wurtz RH., J. Neurophysiol. 60(2), 1988
PMID: 3171643
Komatsu H, Wurtz RH., J. Neurophysiol. 60(2), 1988
PMID: 3171643
MST neuronal responses to heading direction during pursuit eye movements.
Page WK, Duffy CJ., J. Neurophysiol. 81(2), 1999
PMID: 10036263
Page WK, Duffy CJ., J. Neurophysiol. 81(2), 1999
PMID: 10036263
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Quellen
PMID: 18632403
PubMed | Europe PMC
Suchen in
Google Scholar