Optimal integration of shape information from vision and touch

Helbig HB, Ernst MO (2007)
Experimental Brain Research 179(4): 595-606.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Helbig, Hannah B.; Ernst, Marc O.UniBi
Abstract / Bemerkung
Many tasks can be carried out by using several sources of information. For example, an object's size and shape can be judged based on visual as well as haptic cues. It has been shown recently that human observers integrate visual and haptic size information in a statistically optimal fashion, in the sense that the integrated estimate is most reliable (Ernst and Banks in Nature 415:429-433, 2002). In the present study, we tested whether this holds also for visual and haptic shape information. In previous studies virtual stimuli were used to test for optimality in integration. Virtual displays may, however, contain additional inappropriate cues that provide conflicting information and thus affect cue integration. Therefore, we studied optimal integration using real objects. Furthermore, we presented visual information via mirrors to create a spatial separation between visual and haptic cues while observers saw their hand touching the object and thus, knew that they were seeing and feeling the same object. Does this knowledge promote integration even though signals are spatially discrepant which has been shown to lead to a breakdown of integration (Gepshtein et al. in J Vis 5:1013-1023, 2005)? Consistent with the model predictions, observers weighted visual and haptic cues to shape according to their reliability: progressively more weight was given to haptics when visual information became less reliable. Moreover, the integrated visual-haptic estimate was more reliable than either unimodal estimate. These findings suggest that observers integrate visual and haptic shape information of real 3D objects. Thereby, knowledge that multisensory signals arise from the same object seems to promote integration.
vision; shape information; multisensory integration; touch; optimal perception
Experimental Brain Research
Page URI


Helbig HB, Ernst MO. Optimal integration of shape information from vision and touch. Experimental Brain Research. 2007;179(4):595-606.
Helbig, H. B., & Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Experimental Brain Research, 179(4), 595-606. https://doi.org/10.1007/s00221-006-0814-y
Helbig, Hannah B., and Ernst, Marc O. 2007. “Optimal integration of shape information from vision and touch”. Experimental Brain Research 179 (4): 595-606.
Helbig, H. B., and Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Experimental Brain Research 179, 595-606.
Helbig, H.B., & Ernst, M.O., 2007. Optimal integration of shape information from vision and touch. Experimental Brain Research, 179(4), p 595-606.
H.B. Helbig and M.O. Ernst, “Optimal integration of shape information from vision and touch”, Experimental Brain Research, vol. 179, 2007, pp. 595-606.
Helbig, H.B., Ernst, M.O.: Optimal integration of shape information from vision and touch. Experimental Brain Research. 179, 595-606 (2007).
Helbig, Hannah B., and Ernst, Marc O. “Optimal integration of shape information from vision and touch”. Experimental Brain Research 179.4 (2007): 595-606.

68 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

3D-printed model improves clinical assessment of surgeons on anatomy.
Zheng B, Wang X, Zheng Y, Feng J., J Robot Surg 13(1), 2019
PMID: 29693206
Suboptimal human multisensory cue combination.
Arnold DH, Petrie K, Murray C, Johnston A., Sci Rep 9(1), 2019
PMID: 30914673
Optimal integration of intraneural somatosensory feedback with visual information: a single-case study.
Risso G, Valle G, Iberite F, Strauss I, Stieglitz T, Controzzi M, Clemente F, Granata G, Rossini PM, Micera S, Baud-Bovy G., Sci Rep 9(1), 2019
PMID: 31133637
Adaptation to proprioceptive targets following visuomotor adaptation.
Flannigan JC, Posthuma RJ, Lombardo JN, Murray C, Cressman EK., Exp Brain Res 236(2), 2018
PMID: 29209829
Evaluating Integration Strategies for Visuo-Haptic Object Recognition.
Toprak S, Navarro-Guerrero N, Wermter S., Cognit Comput 10(3), 2018
PMID: 29881470
Does hearing aid use affect audiovisual integration in mild hearing impairment?
Gieseler A, Tahden MAS, Thiel CM, Colonius H., Exp Brain Res 236(4), 2018
PMID: 29453491
Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception.
Acerbi L, Dokka K, Angelaki DE, Ma WJ., PLoS Comput Biol 14(7), 2018
PMID: 30052625
Intra-auditory integration between pitch and loudness in humans: Evidence of super-optimal integration at moderate uncertainty in auditory signals.
Koh K, Kwon HJ, Kiemel T, Miller RH, Park YS, Kim MJ, Kwon YH, Kim YH, Shim JK., Sci Rep 8(1), 2018
PMID: 30209342
Visual and cross-modal cues increase the identification of overlapping visual stimuli in Balint's syndrome.
D'Imperio D, Scandola M, Gobbetto V, Bulgarelli C, Salgarello M, Avesani R, Moro V., J Clin Exp Neuropsychol 39(8), 2017
PMID: 28078966
Trust in haptic assistance: weighting visual and haptic cues based on error history.
Gibo TL, Mugge W, Abbink DA., Exp Brain Res 235(8), 2017
PMID: 28534068
Illusory visual-depth reversal can modulate sensations of contact surface.
Igarashi Y, Omori K, Arai T, Aizawa Y., Exp Brain Res 235(10), 2017
PMID: 28721518
Multisensory emotion perception in congenitally, early, and late deaf CI users.
Fengler I, Nava E, Villwock AK, Büchner A, Lenarz T, Röder B., PLoS One 12(10), 2017
PMID: 29023525
Interval timing, temporal averaging, and cue integration.
De Corte BJ, Matell MS., Curr Opin Behav Sci 8(), 2016
PMID: 27175440
Visual gravity contributes to subjective first-person perspective.
Pfeiffer C, Grivaz P, Herbelin B, Serino A, Blanke O., Neurosci Conscious 2016(1), 2016
PMID: 30109127
Intra-Auditory Integration Improves Motor Performance and Synergy in an Accurate Multi-Finger Pressing Task.
Koh K, Kwon HJ, Park YS, Kiemel T, Miller RH, Kim YH, Shin JH, Shim JK., Front Hum Neurosci 10(), 2016
PMID: 27375457
Bayesian Alternation during Tactile Augmentation.
Goeke CM, Planera S, Finger H, König P., Front Behav Neurosci 10(), 2016
PMID: 27774057
Multisensory interactions between vestibular, visual and somatosensory signals.
Ferrè ER, Walther LE, Haggard P., PLoS One 10(4), 2015
PMID: 25875819
Crossmodal enhancement in the LOC for visuohaptic object recognition over development.
Jao RJ, James TW, James KH., Neuropsychologia 77(), 2015
PMID: 26272239
The contributions of vision and haptics to reaching and grasping.
Stone KD, Gonzalez CL., Front Psychol 6(), 2015
PMID: 26441777
Haptic perception accuracy depending on self-produced movement.
Park C, Kim S., J Sports Sci 32(10), 2014
PMID: 24479565
Short-term plasticity of visuo-haptic object recognition.
Kassuba T, Klinge C, Hölig C, Röder B, Siebner HR., Front Psychol 5(), 2014
PMID: 24765082
Vision holds a greater share in visuo-haptic object recognition than touch.
Kassuba T, Klinge C, Hölig C, Röder B, Siebner HR., Neuroimage 65(), 2013
PMID: 23032487
Roughness perception of unfamiliar dot pattern textures.
Eck J, Kaas AL, Mulders JL, Goebel R., Acta Psychol (Amst) 143(1), 2013
PMID: 23500111
Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator.
Spillmann J, Tuchschmid S, Harders M., IEEE Trans Vis Comput Graph 19(4), 2013
PMID: 23428447
Isolating shape from semantics in haptic-visual priming.
Pesquita A, Brennan AA, Enns JT, Soto-Faraco S., Exp Brain Res 227(3), 2013
PMID: 23686149
Falling skyscrapers: when cross-modal perception of verticality fails.
Tseng CH, Chow HM, Spillmann L., Psychol Sci 24(7), 2013
PMID: 23722979
Visual and haptic integration in the estimation of softness of deformable objects.
Cellini C, Kaim L, Drewing K., Iperception 4(8), 2013
PMID: 25165510
The neural mechanisms of reliability weighted integration of shape information from vision and touch.
Helbig HB, Ernst MO, Ricciardi E, Pietrini P, Thielscher A, Mayer KM, Schultz J, Noppeney U., Neuroimage 60(2), 2012
PMID: 22001262
Investigating the mechanisms of visually-evoked tactile sensations.
McKenzie KJ, Lloyd DM, Brown RJ, Plummer F, Poliakoff E., Acta Psychol (Amst) 139(1), 2012
PMID: 22018658
Continuous evolution of statistical estimators for optimal decision-making.
Saunders I, Vijayakumar S., PLoS One 7(6), 2012
PMID: 22761657
Capture of kinesthesis by a competing cutaneous input.
Van Doorn GH, Hohwy J, Symmons MA., Atten Percept Psychophys 74(7), 2012
PMID: 22661281
Integration of disparity and velocity information for haptic and perceptual judgments of object depth.
Foster R, Fantoni C, Caudek C, Domini F., Acta Psychol (Amst) 136(3), 2011
PMID: 21237442
Testing the limits of optimal integration of visual and proprioceptive information of path trajectory.
Reuschel J, Rösler F, Henriques DY, Fiehler K., Exp Brain Res 209(4), 2011
PMID: 21347659
Multidimensional processing of dynamic sounds: more than meets the ear.
Liu EH, Mercado E, Church BA., Atten Percept Psychophys 73(8), 2011
PMID: 21826552
Optimal integration of visual and proprioceptive movement information for the perception of trajectory geometry.
Reuschel J, Drewing K, Henriques DY, Rösler F, Fiehler K., Exp Brain Res 201(4), 2010
PMID: 19953230
Integrating information from vision and touch: a neural network modeling study.
Magosso E., IEEE Trans Inf Technol Biomed 14(3), 2010
PMID: 20129867
Optimality in mono- and multisensory map formation.
Bürck M, Friedel P, Sichert AB, Vossen C, van Hemmen JL., Biol Cybern 103(1), 2010
PMID: 20502911
Neural substrates of reliability-weighted visual-tactile multisensory integration.
Beauchamp MS, Pasalar S, Ro T., Front Syst Neurosci 4(), 2010
PMID: 20631844
Haptic perception disambiguates visual perception of 3D shape.
Wijntjes MW, Volcic R, Pont SC, Koenderink JJ, Kappers AM., Exp Brain Res 193(4), 2009
PMID: 19199097
Optokinetic stimulation induces illusory movement of both out-of-the-body and on-the-body hand-held visual objects.
Revol P, Farnè A, Pisella L, Holmes NP, Imai A, Susami K, Koga K, Rossetti Y., Exp Brain Res 193(4), 2009
PMID: 19199099
The combined effect of muscle contraction history and motor commands on human position sense.
Walsh LD, Smith JL, Gandevia SC, Taylor JL., Exp Brain Res 195(4), 2009
PMID: 19452145
Material properties determine how force and position signals combine in haptic shape perception.
Drewing K, Wiecki TV, Ernst MO., Acta Psychol (Amst) 128(2), 2008
PMID: 18359467
Young children do not integrate visual and haptic form information.
Gori M, Del Viva M, Sandini G, Burr DC., Curr Biol 18(9), 2008
PMID: 18450446
Multisensory integration: a late bloomer.
Ernst MO., Curr Biol 18(12), 2008
PMID: 18579094
Using curvature information in haptic shape perception of 3D objects.
van der Horst BJ, Kappers AM., Exp Brain Res 190(3), 2008
PMID: 18597083
How the parallel channels of the retina contribute to depth processing.
Schiller PH, Slocum WM, Weiner VS., Eur J Neurosci 26(5), 2007
PMID: 17767508

29 References

Daten bereitgestellt von Europe PubMed Central.

P, 2004
Shape from texture: ideal observers and human psychophysics.
Blake A, Bulthoff HH, Sheinberg D., Vision Res. 33(12), 1993
PMID: 8236859
Feeling what you hear: auditory signals can modulate tactile tap perception.
Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A., Exp Brain Res 162(2), 2004
PMID: 15791465

Multisensory integration, perception and ecological validity.
De Gelder B, Bertelson P., Trends Cogn. Sci. (Regul. Ed.) 7(10), 2003
PMID: 14550494
Merging the senses into a robust percept.
Ernst MO, Bulthoff HH., Trends Cogn. Sci. (Regul. Ed.) 8(4), 2004
PMID: 15050512
The combination of vision and touch depends on spatial proximity.
Gepshtein S, Burge J, Ernst MO, Banks MS., J Vis 5(11), 2005
PMID: 16441199

Touch dominates haptic estimates of discordant visual-haptic size.
Hershberger WA, Misceo GF., Percept Psychophys 58(7), 1996
PMID: 8920847
Slant from texture and disparity cues: optimal cue combination.
Hillis JM, Watt SJ, Landy MS, Banks MS., J Vis 4(12), 2004
PMID: 15669906
Optimal integration of texture and motion cues to depth.
Jacobs RA., Vision Res. 39(21), 1999
PMID: 10746132
What determines visual cue reliability?
Jacobs RA., Trends Cogn. Sci. (Regul. Ed.) 6(8), 2002
PMID: 12140085
Memory psychophysics for visual area and length.
Kerst SM, Howard JH Jr., Mem Cognit 6(3), 1978
PMID: 682957

RE, Diss Abstr 27(), 1966
Ideal cue combination for localizing texture-defined edges.
Landy MS, Kojima H., J Opt Soc Am A Opt Image Sci Vis 18(9), 2001
PMID: 11551065
Measurement and modeling of depth cue combination: in defense of weak fusion.
Landy MS, Maloney LT, Johnston EB, Young M., Vision Res. 35(3), 1995
PMID: 7892735

PM, Can J Exp Psychol 26(), 1972
Psychophysical functions for perceived and remembered size.
Moyer RS, Bradley DR, Sorensen MH, Whiting C, Mansfield DP., Science 200(4339), 1978
PMID: 635592

I, Science 7(), 1964
An analysis of binocular slant contrast.
van Ee R, Banks MS, Backus BT., Perception 28(9), 1999
PMID: 10694962
The psychometric function: I. Fitting, sampling, and goodness of fit.
Wichmann FA, Hill NJ., Percept Psychophys 63(8), 2001
PMID: 11800458

AL, 1996

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

PMID: 17225091
PubMed | Europe PMC

Suchen in

Google Scholar