Noise, multisensory integration, and previous response in perceptual disambiguation

Parise C, Ernst MO (2017)
PLOS Computational Biology 13(7): e1005546.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 2.69 MB
Abstract / Bemerkung
Sensory information about the state of the world is generally ambiguous. Understanding how the nervous system resolves such ambiguities to infer the actual state of the world is a central quest for sensory neuroscience. However, the computational principles of perceptual disambiguation are still poorly understood: What drives perceptual decision-making between multiple equally valid solutions? Here we investigate how humans gather and combine sensory information–within and across modalities–to disambiguate motion perception in an ambiguous audiovisual display, where two moving stimuli could appear as either streaming through, or bouncing off each other. By combining psychophysical classification tasks with reverse correlation analyses, we identified the particular spatiotemporal stimulus patterns that elicit a stream or a bounce percept, respectively. From that, we developed and tested a computational model for uni- and multi-sensory perceptual disambiguation that tightly replicates human performance. Specifically, disambiguation relies on knowledge of prototypical bouncing events that contain characteristic patterns of motion energy in the dynamic visual display. Next, the visual information is linearly integrated with auditory cues and prior knowledge about the history of recent perceptual interpretations. What is more, we demonstrate that perceptual decision-making with ambiguous displays is systematically driven by noise, whose random patterns not only promote alternation, but also provide signal-like information that biases perception in highly predictable fashion.
Erscheinungsjahr
2017
Zeitschriftentitel
PLOS Computational Biology
Band
13
Ausgabe
7
Art.-Nr.
e1005546
ISSN
1553-734x
eISSN
1553-7358
Page URI
https://pub.uni-bielefeld.de/record/2913273

Zitieren

Parise C, Ernst MO. Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology. 2017;13(7): e1005546.
Parise, C., & Ernst, M. O. (2017). Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology, 13(7), e1005546. doi:10.1371/journal.pcbi.1005546
Parise, C., and Ernst, M. O. (2017). Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology 13:e1005546.
Parise, C., & Ernst, M.O., 2017. Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology, 13(7): e1005546.
C. Parise and M.O. Ernst, “Noise, multisensory integration, and previous response in perceptual disambiguation”, PLOS Computational Biology, vol. 13, 2017, : e1005546.
Parise, C., Ernst, M.O.: Noise, multisensory integration, and previous response in perceptual disambiguation. PLOS Computational Biology. 13, : e1005546 (2017).
Parise, Cesare, and Ernst, Marc O. “Noise, multisensory integration, and previous response in perceptual disambiguation”. PLOS Computational Biology 13.7 (2017): e1005546.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:50Z
MD5 Prüfsumme
c54064204d346cfef6d08fbe77293e94

1 Zitation in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Are We Ready for Real-world Neuroscience?
Matusz PJ, Dikker S, Huth AG, Perrodin C., J Cogn Neurosci 31(3), 2019
PMID: 29916793

57 References

Daten bereitgestellt von Europe PubMed Central.

Beobachtungen über phänomenale Identität (Observations about phenomenal identity)
AUTHOR UNKNOWN, 1934
Observations on some remarkable phenomenon which occurs in viewing a figure of a crystal or geometrical solid
AUTHOR UNKNOWN, 1832

AUTHOR UNKNOWN, 2005
Sound alters visual motion perception.
Sekuler R, Sekuler AB, Lau R., Nature 385(6614), 1997
PMID: 9002513
Learning to use an invisible visual signal for perception.
Di Luca M, Ernst MO, Backus BT., Curr. Biol. 20(20), 2010
PMID: 20933421
Demonstration of cue recruitment: change in visual appearance by means of Pavlovian conditioning.
Haijiang Q, Saunders JA, Stone RW, Backus BT., Proc. Natl. Acad. Sci. U.S.A. 103(2), 2005
PMID: 16387858
Flash suppression and flash facilitation in binocular rivalry.
Brascamp JW, Knapen TH, Kanai R, van Ee R, van den Berg AV., J Vis 7(12), 2007
PMID: 17997654
Stable perception of visually ambiguous patterns.
Leopold DA, Wilke M, Maier A, Logothetis NK., Nat. Neurosci. 5(6), 2002
PMID: 11992115
REVERSIBILITY OF THE NECKER CUBE. I. AN EXAMINATION OF THE CONCEPT OF "SATIATION OF ORIENTATION".
ORBACH J, EHRLICH D, HEATH HA., Percept Mot Skills 17(), 1963
PMID: 14065532
A short-term memory of multi-stable perception.
Pastukhov A, Braun J., J Vis 8(13), 2008
PMID: 19146337
Sensory memory for ambiguous vision.
Pearson J, Brascamp J., Trends Cogn. Sci. (Regul. Ed.) 12(9), 2008
PMID: 18684661
Multi-timescale perceptual history resolves visual ambiguity.
Brascamp JW, Knapen TH, Kanai R, Noest AJ, van Ee R, van den Berg AV., PLoS ONE 3(1), 2008
PMID: 18231584
Past trials influence perception of ambiguous motion quartets through pattern completion.
Maloney LT, Dal Martello MF, Sahm C, Spillmann L., Proc. Natl. Acad. Sci. U.S.A. 102(8), 2005
PMID: 15710897

AUTHOR UNKNOWN, 1966
Noise in the nervous system.
Faisal AA, Selen LP, Wolpert DM., Nat. Rev. Neurosci. 9(4), 2008
PMID: 18319728
The human eye is an example of robust optical design.
Artal P, Benito A, Tabernero J., J Vis 6(1), 2006
PMID: 16489854
Noise-induced alternations in an attractor network model of perceptual bistability.
Moreno-Bote R, Rinzel J, Rubin N., J. Neurophysiol. 98(3), 2007
PMID: 17615138
Percept-choice sequences driven by interrupted ambiguous stimuli: a low-level neural model.
Noest AJ, van Ee R, Nijs MM, van Wezel RJ., J Vis 7(8), 2007
PMID: 17685817
A spiking neuron model for binocular rivalry.
Laing CR, Chow CC., J Comput Neurosci 12(1), 2002
PMID: 11932559
Stochastic resonance in binocular rivalry.
Kim YJ, Grabowecky M, Suzuki S., Vision Res. 46(3), 2005
PMID: 16183099
Why use noise?
AUTHOR UNKNOWN, 1999
Information-limiting correlations.
Moreno-Bote R, Beck J, Kanitscheider I, Pitkow X, Latham P, Pouget A., Nat. Neurosci. 17(10), 2014
PMID: 25195105
Stimulus features in signal detection
AUTHOR UNKNOWN, 1971
Perceptual classification images from Vernier acuity masked by noise
AUTHOR UNKNOWN, 1996

AUTHOR UNKNOWN, 2014
Measurement and modeling of depth cue combination: in defense of weak fusion.
Landy MS, Maloney LT, Johnston EB, Young M., Vision Res. 35(3), 1995
PMID: 7892735
Percept-choice sequences driven by interrupted ambiguous stimuli: a low-level neural model.
Noest AJ, van Ee R, Nijs MM, van Wezel RJ., J Vis 7(8), 2007
PMID: 17685817
Transformation priming helps to disambiguate sudden changes of sensory inputs.
Pastukhov A, Vivian-Griffiths S, Braun J., Vision Res. 116(Pt A), 2015
PMID: 26416529
Perception of temporally interleaved ambiguous patterns.
Maier A, Wilke M, Logothetis NK, Leopold DA., Curr. Biol. 13(13), 2003
PMID: 12842006
Acoustic cues to visual detection: A classification image study
AUTHOR UNKNOWN, 2011
Auditory transients do not affect visual sensitivity in discriminating between objective streaming and bouncing events
AUTHOR UNKNOWN, 2012
The what and why of perceptual asymmetries in the visual domain.
Karim AK, Kojima H., Adv Cogn Psychol 6(), 2010
PMID: 21228922
Spatiotemporal energy models for the perception of motion.
Adelson EH, Bergen JR., J Opt Soc Am A 2(2), 1985
PMID: 3973762
Perceived rate of movement depends on contrast.
Thompson P., Vision Res. 22(3), 1982
PMID: 7090191
Changes of mind in decision-making.
Resulaj A, Kiani R, Wolpert DM, Shadlen MN., Nature 461(7261), 2009
PMID: 19693010

AUTHOR UNKNOWN, 2011
Recalibration of audiovisual simultaneity.
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098
Attentional modulation in perception of visual motion events.
Watanabe K, Shimojo S., Perception 27(9), 1998
PMID: 10341934
Revealing the origin of the audiovisual bounce-inducing effect.
Grassi M, Casco C., Seeing Perceiving 25(2), 2012
PMID: 22370960
Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision
AUTHOR UNKNOWN, 2010
Audiovisual bounce-inducing effect: attention alone does not explain why the discs are bouncing.
Grassi M, Casco C., J Exp Psychol Hum Percept Perform 35(1), 2009
PMID: 19170485
Neural correlates of cross-modal binding.
Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, Hallett M., Nat. Neurosci. 6(2), 2003
PMID: 12496761
What's new in Psychtoolbox-3
AUTHOR UNKNOWN, 2007

AUTHOR UNKNOWN, 2012

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

Quellen

PMID: 28692700
PubMed | Europe PMC

Suchen in

Google Scholar