The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch

Wallraven C, Buelthoff H, Waterkamp S, van Dam L, Gaissert N (2014)
Psychonomic Bulletin & Review 21(4): 976-985.

Journal Article | Published | English

No fulltext has been uploaded

Author
; ; ; ;
Abstract
Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computergenerated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically.We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Wallraven C, Buelthoff H, Waterkamp S, van Dam L, Gaissert N. The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch. Psychonomic Bulletin & Review. 2014;21(4):976-985.
Wallraven, C., Buelthoff, H., Waterkamp, S., van Dam, L., & Gaissert, N. (2014). The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch. Psychonomic Bulletin & Review, 21(4), 976-985.
Wallraven, C., Buelthoff, H., Waterkamp, S., van Dam, L., and Gaissert, N. (2014). The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch. Psychonomic Bulletin & Review 21, 976-985.
Wallraven, C., et al., 2014. The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch. Psychonomic Bulletin & Review, 21(4), p 976-985.
C. Wallraven, et al., “The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch”, Psychonomic Bulletin & Review, vol. 21, 2014, pp. 976-985.
Wallraven, C., Buelthoff, H., Waterkamp, S., van Dam, L., Gaissert, N.: The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch. Psychonomic Bulletin & Review. 21, 976-985 (2014).
Wallraven, Christian, Buelthoff, Heinrich, Waterkamp, Steffen, van Dam, Loes, and Gaissert, Nina. “The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch”. Psychonomic Bulletin & Review 21.4 (2014): 976-985.
This data publication is cited in the following publications:
This publication cites the following data publications:

20 References

Data provided by Europe PubMed Central.


MH, 1987

EW, Journal of Experimental Psychology: Human Perception and Performance 25(), 1999
Multimodal similarity and categorization of novel, three-dimensional objects.
Cooke T, Jakel F, Wallraven C, Bulthoff HH., Neuropsychologia 45(3), 2007
PMID: 16580027

L, IEEE Transactions on Haptics 200(), 2009
Renewing the respect for similarity.
Edelman S, Shahbazi R., Front Comput Neurosci 6(), 2012
PMID: 22811664

N, Experimental Brain Research 216(), 2011
Alternation rate in perceptual bistability is maximal at and symmetric around equi-dominance.
Moreno-Bote R, Shpiro A, Rinzel J, Rubin N., J Vis 10(11), 2010
PMID: 20884496

S, 1987
Categorical perception for unfamiliar faces. The effect of covert and overt face learning.
Kikutani M, Roberson D, Hanley JR., Psychol Sci 21(6), 2010
PMID: 20483817
Identifying objects by touch: an "expert system".
Klatzky RL, Lederman SJ, Metzger VA., Percept Psychophys 37(4), 1985
PMID: 4034346
Vision and touch: multiple or multisensory representations of objects?
Lacey S, Campbell C, Sathian K., Perception 36(10), 2007
PMID: 18265834
Categorical perception of familiar objects.
Newell FN, Bulthoff HH., Cognition 85(2), 2002
PMID: 12127696
The visual and haptic perception of natural object shape.
Norman JF, Norman HF, Clayton AM, Lianekhammy J, Zielke G., Percept Psychophys 66(2), 2004
PMID: 15129753

RE, 1987
Perceptual equivalence between vision and touch is complexity dependent.
Phillips F, Egan EJ, Perry BN., Acta Psychol (Amst) 132(3), 2009
PMID: 19691944

JM, Journal of Experimental Psychology: Learning, Memory, and Cognition 25(), 1999

E, Cognitive Psychology 8(), 1976
The psychometric function: I. Fitting, sampling, and goodness of fit.
Wichmann FA, Hill NJ., Percept Psychophys 63(8), 2001
PMID: 11800458

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 24307250
PubMed | Europe PMC

Search this title in

Google Scholar