Cross-modal perception of actively explored objects

Newell F, Bülthoff HH, Ernst MO (2003)
In: Proceedings EuroHaptics 2003. Oakley HS, O'Modhrain S (Eds);Dublin, Ireland: Trinity College Dublin: 291-299.

Conference Paper | Published | English

No fulltext has been uploaded

Author
; ;
Editor
Oakley, H S ; O'Modhrain, S
Abstract
Many objects in our world can be picked up and freely manipulated, thus allowing information about an object to be available to both the visual and haptic systems. However, we understand very little about how object information is shared across the modalities. Under constrained viewing cross-modal object recognition is most efficient when the same surface of an object is presented to the visual and haptic systems [5]. Here we tested cross modal recognition of novel objects under active manipulation and unconstrained viewing of the objects. These objects were designed such that each surface of the object provided unique information. In Experiment 1, participants were allowed 30 seconds to learn the objects visually or haptically. Haptic learning resulted in relatively poor haptic recognition performance relative to visual recognition. In Experiment 2, we increased the learning time for haptic exploration and found equivalent haptic and visual recognition, but a cost in cross modal recognition. In Exper iment 3, participants learned the objects using both modalities together, vision alone or haptics alone. Recognition performance was tested using both modalities together. We found that recognition performance was significantly better when objects were learned by both modalities than either of the modalities alone. Our results suggest that efficient cross modal performance depends on the spatial correspondence of object surface information across modalities.
Publishing Year
PUB-ID

Cite this

Newell F, Bülthoff HH, Ernst MO. Cross-modal perception of actively explored objects. In: Oakley HS, O'Modhrain S, eds. Proceedings EuroHaptics 2003. Dublin, Ireland: Trinity College Dublin; 2003: 291-299.
Newell, F., Bülthoff, H. H., & Ernst, M. O. (2003). Cross-modal perception of actively explored objects. In H. S. Oakley & S. O'Modhrain (Eds.), Proceedings EuroHaptics 2003 (pp. 291-299). Dublin, Ireland: Trinity College Dublin.
Newell, F., Bülthoff, H. H., and Ernst, M. O. (2003). “Cross-modal perception of actively explored objects” in Proceedings EuroHaptics 2003, ed. H. S. Oakley and S. O'Modhrain (Dublin, Ireland: Trinity College Dublin), 291-299.
Newell, F., Bülthoff, H.H., & Ernst, M.O., 2003. Cross-modal perception of actively explored objects. In H. S. Oakley & S. O'Modhrain, eds. Proceedings EuroHaptics 2003. Dublin, Ireland: Trinity College Dublin, pp. 291-299.
F. Newell, H.H. Bülthoff, and M.O. Ernst, “Cross-modal perception of actively explored objects”, Proceedings EuroHaptics 2003, H.S. Oakley and S. O'Modhrain, eds., Dublin, Ireland: Trinity College Dublin, 2003, pp.291-299.
Newell, F., Bülthoff, H.H., Ernst, M.O.: Cross-modal perception of actively explored objects. In: Oakley, H.S. and O'Modhrain, S. (eds.) Proceedings EuroHaptics 2003. p. 291-299. Trinity College Dublin, Dublin, Ireland (2003).
Newell, F, Bülthoff, H H, and Ernst, Marc O. “Cross-modal perception of actively explored objects”. Proceedings EuroHaptics 2003. Ed. H S Oakley and S O'Modhrain. Dublin, Ireland: Trinity College Dublin, 2003. 291-299.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar