Optimal integration of shape information from vision and touch

Helbig HB, Ernst MO (2007)
Experimental Brain Research 179(4): 595-606.

No fulltext has been uploaded. References only!
Journal Article | Original Article | Published | English

No fulltext has been uploaded

Many tasks can be carried out by using several sources of information. For example, an object's size and shape can be judged based on visual as well as haptic cues. It has been shown recently that human observers integrate visual and haptic size information in a statistically optimal fashion, in the sense that the integrated estimate is most reliable (Ernst and Banks in Nature 415:429-433, 2002). In the present study, we tested whether this holds also for visual and haptic shape information. In previous studies virtual stimuli were used to test for optimality in integration. Virtual displays may, however, contain additional inappropriate cues that provide conflicting information and thus affect cue integration. Therefore, we studied optimal integration using real objects. Furthermore, we presented visual information via mirrors to create a spatial separation between visual and haptic cues while observers saw their hand touching the object and thus, knew that they were seeing and feeling the same object. Does this knowledge promote integration even though signals are spatially discrepant which has been shown to lead to a breakdown of integration (Gepshtein et al. in J Vis 5:1013-1023, 2005)? Consistent with the model predictions, observers weighted visual and haptic cues to shape according to their reliability: progressively more weight was given to haptics when visual information became less reliable. Moreover, the integrated visual-haptic estimate was more reliable than either unimodal estimate. These findings suggest that observers integrate visual and haptic shape information of real 3D objects. Thereby, knowledge that multisensory signals arise from the same object seems to promote integration.
Publishing Year

Cite this

Helbig HB, Ernst MO. Optimal integration of shape information from vision and touch. Experimental Brain Research. 2007;179(4):595-606.
Helbig, H. B., & Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Experimental Brain Research, 179(4), 595-606. doi:10.1007/s00221-006-0814-y
Helbig, H. B., and Ernst, M. O. (2007). Optimal integration of shape information from vision and touch. Experimental Brain Research 179, 595-606.
Helbig, H.B., & Ernst, M.O., 2007. Optimal integration of shape information from vision and touch. Experimental Brain Research, 179(4), p 595-606.
H.B. Helbig and M.O. Ernst, “Optimal integration of shape information from vision and touch”, Experimental Brain Research, vol. 179, 2007, pp. 595-606.
Helbig, H.B., Ernst, M.O.: Optimal integration of shape information from vision and touch. Experimental Brain Research. 179, 595-606 (2007).
Helbig, Hannah B., and Ernst, Marc O. “Optimal integration of shape information from vision and touch”. Experimental Brain Research 179.4 (2007): 595-606.
This data publication is cited in the following publications:
This publication cites the following data publications:

44 Citations in Europe PMC

Data provided by Europe PubMed Central.

The contributions of vision and haptics to reaching and grasping.
Stone KD, Gonzalez CL., Front Psychol 6(), 2015
PMID: 26441777
Multisensory interactions between vestibular, visual and somatosensory signals.
Ferre ER, Walther LE, Haggard P., PLoS ONE 10(4), 2015
PMID: 25875819
Short-term plasticity of visuo-haptic object recognition.
Kassuba T, Klinge C, Holig C, Roder B, Siebner HR., Front Psychol 5(), 2014
PMID: 24765082
Haptic perception accuracy depending on self-produced movement.
Park C, Kim S., J Sports Sci 32(10), 2014
PMID: 24479565
Visual and haptic integration in the estimation of softness of deformable objects.
Cellini C, Kaim L, Drewing K., Iperception 4(8), 2013
PMID: 25165510
Isolating shape from semantics in haptic-visual priming.
Pesquita A, Brennan AA, Enns JT, Soto-Faraco S., Exp Brain Res 227(3), 2013
PMID: 23686149
Roughness perception of unfamiliar dot pattern textures.
Eck J, Kaas AL, Mulders JL, Goebel R., Acta Psychol (Amst) 143(1), 2013
PMID: 23500111
Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator.
Spillmann J, Tuchschmid S, Harders M., IEEE Trans Vis Comput Graph 19(4), 2013
PMID: 23428447
Continuous evolution of statistical estimators for optimal decision-making.
Saunders I, Vijayakumar S., PLoS ONE 7(6), 2012
PMID: 22761657
Capture of kinesthesis by a competing cutaneous input.
Van Doorn GH, Hohwy J, Symmons MA., Atten Percept Psychophys 74(7), 2012
PMID: 22661281
Investigating the mechanisms of visually-evoked tactile sensations.
McKenzie KJ, Lloyd DM, Brown RJ, Plummer F, Poliakoff E., Acta Psychol (Amst) 139(1), 2012
PMID: 22018658
Multidimensional processing of dynamic sounds: more than meets the ear.
Liu EH, Mercado E 3rd, Church BA., Atten Percept Psychophys 73(8), 2011
PMID: 21826552
Optimality in mono- and multisensory map formation.
Burck M, Friedel P, Sichert AB, Vossen C, van Hemmen JL., Biol Cybern 103(1), 2010
PMID: 20502911
Optokinetic stimulation induces illusory movement of both out-of-the-body and on-the-body hand-held visual objects.
Revol P, Farne A, Pisella L, Holmes NP, Imai A, Susami K, Koga K, Rossetti Y., Exp Brain Res 193(4), 2009
PMID: 19199099

29 References

Data provided by Europe PubMed Central.

I, Science 7(), 1964
An analysis of binocular slant contrast.
van Ee R, Banks MS, Backus BT., Perception 28(9), 1999
PMID: 10694962
The psychometric function: I. Fitting, sampling, and goodness of fit.
Wichmann FA, Hill NJ., Percept Psychophys 63(8), 2001
PMID: 11800458

AL, 1996


0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®


PMID: 17225091
PubMed | Europe PMC

Search this title in

Google Scholar