Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity
Kayser S, Kayser C (2018)
Scientific Reports 8(1): 3742.
Zeitschriftenaufsatz
| Veröffentlicht | Englisch
Download
s41598-018-22137-8.kayser.pdf
2.11 MB
Autor*in
Einrichtung
Abstract / Bemerkung
A well-known effect in multisensory perception is that congruent information received by different senses usually leads to faster and more accurate responses. Less well understood are trial-by-trial interactions, whereby the multisensory composition of stimuli experienced during previous trials shapes performance during a subsequent trial. We here exploit the analogy of multisensory paradigms with classical flanker tasks to investigate the neural correlates underlying trial-by-trial interactions of multisensory congruency. Studying an audio-visual motion task, we demonstrate that congruency benefits for accuracy and reaction times are reduced following an audio-visual incongruent compared to a congruent preceding trial. Using single trial analysis of motion-sensitive EEG components we then localize current-trial and serial interaction effects within distinct brain regions: while the multisensory congruency experienced during the current trial influences the encoding of task-relevant information in sensory-specific brain regions, the serial interaction arises from task-relevant processes within the inferior frontal lobe. These results highlight parallels between multisensory paradigms and classical flanker tasks and demonstrate a role of amodal association cortices in shaping perception based on the history of multisensory congruency.
Erscheinungsjahr
2018
Zeitschriftentitel
Scientific Reports
Band
8
Ausgabe
1
Art.-Nr.
3742
Urheberrecht / Lizenzen
ISSN
2045-2322
Page URI
https://pub.uni-bielefeld.de/record/2918229
Zitieren
Kayser S, Kayser C. Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports. 2018;8(1): 3742.
Kayser, S., & Kayser, C. (2018). Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports, 8(1), 3742. doi:10.1038/s41598-018-22137-8
Kayser, Stephanie, and Kayser, Christoph. 2018. “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”. Scientific Reports 8 (1): 3742.
Kayser, S., and Kayser, C. (2018). Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports 8:3742.
Kayser, S., & Kayser, C., 2018. Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports, 8(1): 3742.
S. Kayser and C. Kayser, “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”, Scientific Reports, vol. 8, 2018, : 3742.
Kayser, S., Kayser, C.: Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports. 8, : 3742 (2018).
Kayser, Stephanie, and Kayser, Christoph. “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”. Scientific Reports 8.1 (2018): 3742.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Name
s41598-018-22137-8.kayser.pdf
2.11 MB
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:57Z
MD5 Prüfsumme
4c61847c277dfecf2db58e4c94775185
Daten bereitgestellt von European Bioinformatics Institute (EBI)
Zitationen in Europe PMC
Daten bereitgestellt von Europe PubMed Central.
65 References
Daten bereitgestellt von Europe PubMed Central.
AUTHOR UNKNOWN, 0
Recalibration of temporal order perception by exposure to audio-visual asynchrony.
Vroomen J, Keetels M, de Gelder B, Bertelson P., Brain Res Cogn Brain Res 22(1), 2004
PMID: 15561498
Vroomen J, Keetels M, de Gelder B, Bertelson P., Brain Res Cogn Brain Res 22(1), 2004
PMID: 15561498
The nonlinear structure of motion perception during smooth eye movements.
Morvan C, Wexler M., J Vis 9(7), 2009
PMID: 19761316
Morvan C, Wexler M., J Vis 9(7), 2009
PMID: 19761316
Recalibration of perceived time across sensory modalities.
Hanson JV, Heron J, Whitaker D., Exp Brain Res 185(2), 2008
PMID: 18236035
Hanson JV, Heron J, Whitaker D., Exp Brain Res 185(2), 2008
PMID: 18236035
Rapid recalibration to audiovisual asynchrony.
Van der Burg E, Alais D, Cass J., J. Neurosci. 33(37), 2013
PMID: 24027264
Van der Burg E, Alais D, Cass J., J. Neurosci. 33(37), 2013
PMID: 24027264
Computational characterization of visually induced auditory spatial adaptation.
Wozny DR, Shams L., Front Integr Neurosci 5(), 2011
PMID: 22069383
Wozny DR, Shams L., Front Integr Neurosci 5(), 2011
PMID: 22069383
Recalibration of auditory space following milliseconds of cross-modal discrepancy.
Wozny DR, Shams L., J. Neurosci. 31(12), 2011
PMID: 21430160
Wozny DR, Shams L., J. Neurosci. 31(12), 2011
PMID: 21430160
Predicting auditory space calibration from recent multisensory experience.
Mendonca C, Escher A, van de Par S, Colonius H., Exp Brain Res 233(7), 2015
PMID: 25795081
Mendonca C, Escher A, van de Par S, Colonius H., Exp Brain Res 233(7), 2015
PMID: 25795081
Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities.
Bosen AK, Fleming JT, Allen PD, O'Neill WE, Paige GD., Exp Brain Res 235(2), 2016
PMID: 27837258
Bosen AK, Fleming JT, Allen PD, O'Neill WE, Paige GD., Exp Brain Res 235(2), 2016
PMID: 27837258
Multisensory simultaneity recalibration: storage of the aftereffect in the absence of counterevidence.
Machulla TK, Di Luca M, Froehlich E, Ernst MO., Exp Brain Res 217(1), 2011
PMID: 22207361
Machulla TK, Di Luca M, Froehlich E, Ernst MO., Exp Brain Res 217(1), 2011
PMID: 22207361
A model-based comparison of three theories of audiovisual temporal recalibration.
Yarrow K, Minaei S, Arnold DH., Cogn Psychol 83(), 2015
PMID: 26545105
Yarrow K, Minaei S, Arnold DH., Cogn Psychol 83(), 2015
PMID: 26545105
Opposite Effects of Recent History on Perception and Decision.
Fritsche M, Mostert P, de Lange FP., Curr. Biol. 27(4), 2017
PMID: 28162897
Fritsche M, Mostert P, de Lange FP., Curr. Biol. 27(4), 2017
PMID: 28162897
Hysteresis in the perception of motion direction as evidence for neural cooperativity.
Williams D, Phillips G, Sekuler R., Nature 324(6094), 1986
PMID: 3785395
Williams D, Phillips G, Sekuler R., Nature 324(6094), 1986
PMID: 3785395
Multi-timescale perceptual history resolves visual ambiguity.
Brascamp JW, Knapen TH, Kanai R, Noest AJ, van Ee R, van den Berg AV., PLoS ONE 3(1), 2008
PMID: 18231584
Brascamp JW, Knapen TH, Kanai R, Noest AJ, van Ee R, van den Berg AV., PLoS ONE 3(1), 2008
PMID: 18231584
Information processing in visual search: a continuous flow conception and experimental results.
Eriksen CW, Schultz DW., Percept Psychophys 25(4), 1979
PMID: 461085
Eriksen CW, Schultz DW., Percept Psychophys 25(4), 1979
PMID: 461085
Conflict monitoring and cognitive control.
Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD., Psychol Rev 108(3), 2001
PMID: 11488380
Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD., Psychol Rev 108(3), 2001
PMID: 11488380
Optimizing the use of information: strategic control of activation of responses.
Gratton G, Coles MG, Donchin E., J Exp Psychol Gen 121(4), 1992
PMID: 1431740
Gratton G, Coles MG, Donchin E., J Exp Psychol Gen 121(4), 1992
PMID: 1431740
Sequential dependencies in the Eriksen flanker task: a direct comparison of two competing accounts.
Davelaar EJ, Stevens J., Psychon Bull Rev 16(1), 2009
PMID: 19145021
Davelaar EJ, Stevens J., Psychon Bull Rev 16(1), 2009
PMID: 19145021
The Gratton effect remains after controlling for contingencies and stimulus repetitions.
Blais C, Stefanidi A, Brewer GA., Front Psychol 5(), 2014
PMID: 25386151
Blais C, Stefanidi A, Brewer GA., Front Psychol 5(), 2014
PMID: 25386151
Spatial attention and audiovisual interactions in apparent motion.
Sanabria D, Soto-Faraco S, Spence C., J Exp Psychol Hum Percept Perform 33(4), 2007
PMID: 17683238
Sanabria D, Soto-Faraco S, Spence C., J Exp Psychol Hum Percept Perform 33(4), 2007
PMID: 17683238
Capturing spatial attention with multisensory cues: a review.
Spence C, Santangelo V., Hear. Res. 258(1-2), 2009
PMID: 19409472
Spence C, Santangelo V., Hear. Res. 258(1-2), 2009
PMID: 19409472
Distinct Computational Principles Govern Multisensory Integration in Primary Sensory and Association Cortices.
Rohe T, Noppeney U., Curr. Biol. 26(4), 2016
PMID: 26853368
Rohe T, Noppeney U., Curr. Biol. 26(4), 2016
PMID: 26853368
Improvement of visual contrast detection by a simultaneous sound.
Lippert M, Logothetis NK, Kayser C., Brain Res. 1173(), 2007
PMID: 17765208
Lippert M, Logothetis NK, Kayser C., Brain Res. 1173(), 2007
PMID: 17765208
Sensory reliability shapes perceptual inference via two mechanisms.
Rohe T, Noppeney U., J Vis 15(5), 2015
PMID: 26067540
Rohe T, Noppeney U., J Vis 15(5), 2015
PMID: 26067540
Acoustic noise improves visual perception and modulates occipital oscillatory states.
Gleiss S, Kayser C., J Cogn Neurosci 26(4), 2013
PMID: 24236698
Gleiss S, Kayser C., J Cogn Neurosci 26(4), 2013
PMID: 24236698
0 + 1 > 1: How adding noninformative sound improves performance on a visual task.
Kim R, Peters MA, Shams L., Psychol Sci 23(1), 2011
PMID: 22127367
Kim R, Peters MA, Shams L., Psychol Sci 23(1), 2011
PMID: 22127367
Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations.
Kayser SJ, Philiastides MG, Kayser C., Neuroimage 148(), 2017
PMID: 28082107
Kayser SJ, Philiastides MG, Kayser C., Neuroimage 148(), 2017
PMID: 28082107
Conditional accuracy in response interference tasks: Evidence from the Eriksen flanker task and the spatial conflict task.
Stins JF, Polderman JC, Boomsma DI, de Geus EJ., Adv Cogn Psychol 3(3), 2008
PMID: 20517524
Stins JF, Polderman JC, Boomsma DI, de Geus EJ., Adv Cogn Psychol 3(3), 2008
PMID: 20517524
FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data.
Oostenveld R, Fries P, Maris E, Schoffelen JM., Comput Intell Neurosci 2011(), 2010
PMID: 21253357
Oostenveld R, Fries P, Maris E, Schoffelen JM., Comput Intell Neurosci 2011(), 2010
PMID: 21253357
Recipes for the linear analysis of EEG.
Parra LC, Spence CD, Gerson AD, Sajda P., Neuroimage 28(2), 2005
PMID: 16084117
Parra LC, Spence CD, Gerson AD, Sajda P., Neuroimage 28(2), 2005
PMID: 16084117
A supramodal accumulation-to-bound signal that determines perceptual decisions in humans.
O'Connell RG, Dockree PM, Kelly SP., Nat. Neurosci. 15(12), 2012
PMID: 23103963
O'Connell RG, Dockree PM, Kelly SP., Nat. Neurosci. 15(12), 2012
PMID: 23103963
Nonparametric statistical testing of EEG- and MEG-data.
Maris E, Oostenveld R., J. Neurosci. Methods 164(1), 2007
PMID: 17517438
Maris E, Oostenveld R., J. Neurosci. Methods 164(1), 2007
PMID: 17517438
Nonparametric permutation tests for functional neuroimaging: a primer with examples.
Nichols TE, Holmes AP., Hum Brain Mapp 15(1), 2002
PMID: 11747097
Nichols TE, Holmes AP., Hum Brain Mapp 15(1), 2002
PMID: 11747097
False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.
Simmons JP, Nelson LD, Simonsohn U., Psychol Sci 22(11), 2011
PMID: 22006061
Simmons JP, Nelson LD, Simonsohn U., Psychol Sci 22(11), 2011
PMID: 22006061
Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates.
Eklund A, Nichols TE, Knutsson H., Proc. Natl. Acad. Sci. U.S.A. 113(28), 2016
PMID: 27357684
Eklund A, Nichols TE, Knutsson H., Proc. Natl. Acad. Sci. U.S.A. 113(28), 2016
PMID: 27357684
Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: A simulation study.
Pernet CR, Latinus M, Nichols TE, Rousselet GA., J. Neurosci. Methods 250(), 2014
PMID: 25128255
Pernet CR, Latinus M, Nichols TE, Rousselet GA., J. Neurosci. Methods 250(), 2014
PMID: 25128255
Y, The Annals of Statistics 29(), 2001
Making sense of all the conflict: a theoretical review and critique of conflict-related ERPs.
Larson MJ, Clayson PE, Clawson A., Int J Psychophysiol 93(3), 2014
PMID: 24950132
Larson MJ, Clayson PE, Clawson A., Int J Psychophysiol 93(3), 2014
PMID: 24950132
The electrophysiological dynamics of interference during the Stroop task.
Hanslmayr S, Pastotter B, Bauml KH, Gruber S, Wimber M, Klimesch W., J Cogn Neurosci 20(2), 2008
PMID: 18275330
Hanslmayr S, Pastotter B, Bauml KH, Gruber S, Wimber M, Klimesch W., J Cogn Neurosci 20(2), 2008
PMID: 18275330
Event-related potential indices of congruency sequence effects without feature integration or contingency learning confounds.
Larson MJ, Clayson PE, Kirwan CB, Weissman DH., Psychophysiology 53(6), 2016
PMID: 26854028
Larson MJ, Clayson PE, Kirwan CB, Weissman DH., Psychophysiology 53(6), 2016
PMID: 26854028
Sounds reset rhythms of visual cortex and corresponding human visual perception.
Romei V, Gross J, Thut G., Curr. Biol. 22(9), 2012
PMID: 22503499
Romei V, Gross J, Thut G., Curr. Biol. 22(9), 2012
PMID: 22503499
Recalibration of audiovisual simultaneity.
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098
Event Related Potentials Index Rapid Recalibration to Audiovisual Temporal Asynchrony.
Simon DM, Noel JP, Wallace MT., Front Integr Neurosci 11(), 2017
PMID: 28381993
Simon DM, Noel JP, Wallace MT., Front Integr Neurosci 11(), 2017
PMID: 28381993
E, Audiovisual temporal recalibration occurs independently at two different time scales 5(), 2015
Can post-error dynamics explain sequential reaction time patterns?
Goldfarb S, Wong-Lin K, Schwemmer M, Leonard NE, Holmes P., Front Psychol 3(), 2012
PMID: 22811671
Goldfarb S, Wong-Lin K, Schwemmer M, Leonard NE, Holmes P., Front Psychol 3(), 2012
PMID: 22811671
Sequential effects in two-choice reaction time tasks: decomposition and synthesis of mechanisms.
Gao J, Wong-Lin K, Holmes P, Simen P, Cohen JD., Neural Comput 21(9), 2009
PMID: 19548803
Gao J, Wong-Lin K, Holmes P, Simen P, Cohen JD., Neural Comput 21(9), 2009
PMID: 19548803
Item-specific adaptation and the conflict-monitoring hypothesis: a computational model.
Blais C, Robidoux S, Risko EF, Besner D., Psychol Rev 114(4), 2007
PMID: 17907873
Blais C, Robidoux S, Risko EF, Besner D., Psychol Rev 114(4), 2007
PMID: 17907873
Specific activation of the V5 brain area by auditory motion processing: an fMRI study.
Poirier C, Collignon O, Devolder AG, Renier L, Vanlierde A, Tranduy D, Scheiber C., Brain Res Cogn Brain Res 25(3), 2005
PMID: 16298112
Poirier C, Collignon O, Devolder AG, Renier L, Vanlierde A, Tranduy D, Scheiber C., Brain Res Cogn Brain Res 25(3), 2005
PMID: 16298112
Capture of auditory motion by vision is represented by an activation shift from auditory to visual motion cortex.
Alink A, Singer W, Muckli L., J. Neurosci. 28(11), 2008
PMID: 18337398
Alink A, Singer W, Muckli L., J. Neurosci. 28(11), 2008
PMID: 18337398
Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing.
Sadaghiani S, Maier JX, Noppeney U., J. Neurosci. 29(20), 2009
PMID: 19458220
Sadaghiani S, Maier JX, Noppeney U., J. Neurosci. 29(20), 2009
PMID: 19458220
Tactile and visual motion direction processing in hMT+/V5.
van Kemenade BM, Seymour K, Wacker E, Spitzer B, Blankenburg F, Sterzer P., Neuroimage 84(), 2013
PMID: 24036354
van Kemenade BM, Seymour K, Wacker E, Spitzer B, Blankenburg F, Sterzer P., Neuroimage 84(), 2013
PMID: 24036354
Decoding sound and imagery content in early visual cortex.
Vetter P, Smith FW, Muckli L., Curr. Biol. 24(11), 2014
PMID: 24856208
Vetter P, Smith FW, Muckli L., Curr. Biol. 24(11), 2014
PMID: 24856208
The classic P300 encodes a build-to-threshold decision variable.
Twomey DM, Murphy PR, Kelly SP, O'Connell RG., Eur. J. Neurosci. 42(1), 2015
PMID: 25925534
Twomey DM, Murphy PR, Kelly SP, O'Connell RG., Eur. J. Neurosci. 42(1), 2015
PMID: 25925534
Conflict monitoring and anterior cingulate cortex: an update.
Botvinick MM, Cohen JD, Carter CS., Trends Cogn. Sci. (Regul. Ed.) 8(12), 2004
PMID: 15556023
Botvinick MM, Cohen JD, Carter CS., Trends Cogn. Sci. (Regul. Ed.) 8(12), 2004
PMID: 15556023
Anterior cingulate and prefrontal cortex: who's in control?
Cohen JD, Botvinick M, Carter CS., Nat. Neurosci. 3(5), 2000
PMID: 10769376
Cohen JD, Botvinick M, Carter CS., Nat. Neurosci. 3(5), 2000
PMID: 10769376
Conflict monitoring versus selection-for-action in anterior cingulate cortex.
Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD., Nature 402(6758), 1999
PMID: 10647008
Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD., Nature 402(6758), 1999
PMID: 10647008
Neural correlates of motor-sensory temporal recalibration.
Stekelenburg JJ, Sugano Y, Vroomen J., Brain Res. 1397(), 2011
PMID: 21600564
Stekelenburg JJ, Sugano Y, Vroomen J., Brain Res. 1397(), 2011
PMID: 21600564
The multifaceted interplay between attention and multisensory integration.
Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20675182
Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20675182
Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?
Talsma D, Doty TJ, Woldorff MG., Cereb. Cortex 17(3), 2006
PMID: 16707740
Talsma D, Doty TJ, Woldorff MG., Cereb. Cortex 17(3), 2006
PMID: 16707740
Selective attention modulates the direction of audio-visual temporal recalibration.
Ikumi N, Soto-Faraco S., PLoS ONE 9(7), 2014
PMID: 25004132
Ikumi N, Soto-Faraco S., PLoS ONE 9(7), 2014
PMID: 25004132
Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection.
Thut G, Nietzel A, Brandt SA, Pascual-Leone A., J. Neurosci. 26(37), 2006
PMID: 16971533
Thut G, Nietzel A, Brandt SA, Pascual-Leone A., J. Neurosci. 26(37), 2006
PMID: 16971533
On the role of prestimulus alpha rhythms over occipito-parietal areas in visual input regulation: correlation or causation?
Romei V, Gross J, Thut G., J. Neurosci. 30(25), 2010
PMID: 20573914
Romei V, Gross J, Thut G., J. Neurosci. 30(25), 2010
PMID: 20573914
Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain.
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M., Neuroimage 15(1), 2002
PMID: 11771995
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M., Neuroimage 15(1), 2002
PMID: 11771995
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Quellen
PMID: 29487374
PubMed | Europe PMC
Suchen in