Noise, multisensory integration, and previous response in perceptual disambiguation

Parise C, Ernst MO (2017)
PLOS Computational Biology 13(7): e1005546.

Download
OA 2.69 MB
Journal Article | Original Article | Published | English
Abstract
Sensory information about the state of the world is generally ambiguous. Understanding how the nervous system resolves such ambiguities to infer the actual state of the world is a central quest for sensory neuroscience. However, the computational principles of perceptual disambiguation are still poorly understood: What drives perceptual decision-making between multiple equally valid solutions? Here we investigate how humans gather and combine sensory information–within and across modalities–to disambiguate motion perception in an ambiguous audiovisual display, where two moving stimuli could appear as either streaming through, or bouncing off each other. By combining psychophysical classification tasks with reverse correlation analyses, we identified the particular spatiotemporal stimulus patterns that elicit a stream or a bounce percept, respectively. From that, we developed and tested a computational model for uni- and multi-sensory perceptual disambiguation that tightly replicates human performance. Specifically, disambiguation relies on knowledge of prototypical bouncing events that contain characteristic patterns of motion energy in the dynamic visual display. Next, the visual information is linearly integrated with auditory cues and prior knowledge about the history of recent perceptual interpretations. What is more, we demonstrate that perceptual decision-making with ambiguous displays is systematically driven by noise, whose random patterns not only promote alternation, but also provide signal-like information that biases perception in highly predictable fashion.
Publishing Year
ISSN
Financial disclosure
Article Processing Charge funded by the Deutsche Forschungsgemeinschaft and the Open Access Publication Fund of Bielefeld University.
PUB-ID

Cite this

Parise C, Ernst MO. Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology. 2017;13(7): e1005546.
Parise, C., & Ernst, M. O. (2017). Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology, 13(7), e1005546. doi:10.1371/journal.pcbi.1005546
Parise, C., and Ernst, M. O. (2017). Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology 13:e1005546.
Parise, C., & Ernst, M.O., 2017. Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology, 13(7): e1005546.
C. Parise and M.O. Ernst, “Noise, multisensory integration, and previous response in perceptual disambiguation”, PLOS Computational Biology, vol. 13, 2017, : e1005546.
Parise, C., Ernst, M.O.: Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology. 13, : e1005546 (2017).
Parise, Cesare, and Ernst, Marc O. “Noise, multisensory integration, and previous response in perceptual disambiguation”. PLOS Computational Biology 13.7 (2017): e1005546.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Main File(s)
Access Level
OA Open Access
Last Uploaded
2017-08-14T12:44:19Z

This data publication is cited in the following publications:
This publication cites the following data publications:

57 References

Data provided by Europe PubMed Central.

Neural correlates of cross-modal binding.
Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, Hallett M., Nat. Neurosci. 6(2), 2003
PMID: 12496761
What's new in Psychtoolbox-3
AUTHOR UNKNOWN, 2007

AUTHOR UNKNOWN, 2012

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 28692700
PubMed | Europe PMC

Search this title in

Google Scholar