Multisensory recognition of actively explored objects

Ernst MO, Lange C, Newell FN (2007)
Canadian Journal of Experimental Psychology 61(3): 242-253.

Journal Article | Published | English

No fulltext has been uploaded

Author
; ;
Abstract
Shape recognition can be achieved through vision or touch, raising the issue of how this information is shared across modalities. Here we provide a short review of previous findings on cross-modal object recognition and we provide new empirical data on multisensory recognition of actively explored objects. It was previously shown that, similar to vision, haptic recognition of objects fixed in space is orientation specific and that cross-modal object recognition performance was relatively efficient when these views of the objects were matched across the sensory modalities (Newell, Ernst, Tjan, & Bulthoff, 2001). For actively explored (i.e., spatially unconstrained) objects, we now found a cost in cross-modal relative to within-modal recognition performance. At first, this may seem to be in contrast to findings by Newell et al. (2001). However, a detailed video analysis of the visual and haptic exploration behaviour during learning and recognition revealed that one view of the objects was predominantly explored relative to all others. Thus, active visual and haptic exploration is not balanced across object views. The cost in recognition performance across modalities for actively explored objects Could be attributed to the fact that the predominantly learned object view was not appropriately matched between learning and recognition test in the cross-modal conditions. Thus, it seems that participants naturally adopt an exploration strategy during visual and haptic object learning that involves constraining the orientation of the objects. Although this strategy ensures good within-modal performance, it is not optimal for achieving the best recognition performance across modalities.
Publishing Year
ISSN
PUB-ID

Cite this

Ernst MO, Lange C, Newell FN. Multisensory recognition of actively explored objects. Canadian Journal of Experimental Psychology. 2007;61(3):242-253.
Ernst, M. O., Lange, C., & Newell, F. N. (2007). Multisensory recognition of actively explored objects. Canadian Journal of Experimental Psychology, 61(3), 242-253.
Ernst, M. O., Lange, C., and Newell, F. N. (2007). Multisensory recognition of actively explored objects. Canadian Journal of Experimental Psychology 61, 242-253.
Ernst, M.O., Lange, C., & Newell, F.N., 2007. Multisensory recognition of actively explored objects. Canadian Journal of Experimental Psychology, 61(3), p 242-253.
M.O. Ernst, C. Lange, and F.N. Newell, “Multisensory recognition of actively explored objects”, Canadian Journal of Experimental Psychology, vol. 61, 2007, pp. 242-253.
Ernst, M.O., Lange, C., Newell, F.N.: Multisensory recognition of actively explored objects. Canadian Journal of Experimental Psychology. 61, 242-253 (2007).
Ernst, Marc O., Lange, Christoph, and Newell, Fiona N. “Multisensory recognition of actively explored objects”. Canadian Journal of Experimental Psychology 61.3 (2007): 242-253.
This data publication is cited in the following publications:
This publication cites the following data publications:

9 Citations in Europe PMC

Data provided by Europe PubMed Central.

Occupants' Perceptions of Amenity and Efficiency for Verification of Spatial Design Adequacy.
Lee S, Wohn K., Int J Environ Res Public Health 13(1), 2016
PMID: 26784211
Cross-modal transitivity in a California sea lion (Zalophus californianus).
Lindemann-Biolsi KL, Reichmuth C., Anim Cogn 17(4), 2014
PMID: 24337783
Where you look can influence haptic object recognition.
Lawson R, Boylan A, Edwards L., Atten Percept Psychophys 76(2), 2014
PMID: 24203675
Isolating shape from semantics in haptic-visual priming.
Pesquita A, Brennan AA, Enns JT, Soto-Faraco S., Exp Brain Res 227(3), 2013
PMID: 23686149
Unimodal and crossmodal working memory representations of visual and kinesthetic movement trajectories.
Seemuller A, Fiehler K, Rosler F., Acta Psychol (Amst) 136(1), 2011
PMID: 20970103
Cross-modal visuo-haptic mental rotation: comparing objects between senses.
Volcic R, Wijntjes MW, Kool EC, Kappers AM., Exp Brain Res 203(3), 2010
PMID: 20437169
Static images of novel, moveable objects learned through touch activate visual area hMT+.
Chan JS, Simoes-Franklin C, Garavan H, Newell FN., Neuroimage 49(2), 2010
PMID: 19815082

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 17974318
PubMed | Europe PMC

Search this title in

Google Scholar