Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity
Kayser S, Kayser C (2018)
Scientific Reports 8(1): 3742.
Zeitschriftenaufsatz
| Veröffentlicht | Englisch
Download

Autor*in
Einrichtung
Abstract / Bemerkung
A well-known effect in multisensory perception is that congruent information received by different senses usually leads to faster and more accurate responses. Less well understood are trial-by-trial interactions, whereby the multisensory composition of stimuli experienced during previous trials shapes performance during a subsequent trial. We here exploit the analogy of multisensory paradigms with classical flanker tasks to investigate the neural correlates underlying trial-by-trial interactions of multisensory congruency. Studying an audio-visual motion task, we demonstrate that congruency benefits for accuracy and reaction times are reduced following an audio-visual incongruent compared to a congruent preceding trial. Using single trial analysis of motion-sensitive EEG components we then localize current-trial and serial interaction effects within distinct brain regions: while the multisensory congruency experienced during the current trial influences the encoding of task-relevant information in sensory-specific brain regions, the serial interaction arises from task-relevant processes within the inferior frontal lobe. These results highlight parallels between multisensory paradigms and classical flanker tasks and demonstrate a role of amodal association cortices in shaping perception based on the history of multisensory congruency.
Erscheinungsjahr
2018
Zeitschriftentitel
Scientific Reports
Band
8
Ausgabe
1
Art.-Nr.
3742
Urheberrecht / Lizenzen
ISSN
2045-2322
Page URI
https://pub.uni-bielefeld.de/record/2918229
Zitieren
Kayser S, Kayser C. Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports. 2018;8(1): 3742.
Kayser, S., & Kayser, C. (2018). Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports, 8(1), 3742. doi:10.1038/s41598-018-22137-8
Kayser, Stephanie, and Kayser, Christoph. 2018. “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”. Scientific Reports 8 (1): 3742.
Kayser, S., and Kayser, C. (2018). Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports 8:3742.
Kayser, S., & Kayser, C., 2018. Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports, 8(1): 3742.
S. Kayser and C. Kayser, “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”, Scientific Reports, vol. 8, 2018, : 3742.
Kayser, S., Kayser, C.: Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity. Scientific Reports. 8, : 3742 (2018).
Kayser, Stephanie, and Kayser, Christoph. “Trial by trial dependencies in multisensory perception and their correlates in dynamic brain activity”. Scientific Reports 8.1 (2018): 3742.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Name
s41598-018-22137-8.kayser.pdf
2.11 MB
Access Level

Zuletzt Hochgeladen
2019-09-06T09:18:57Z
MD5 Prüfsumme
4c61847c277dfecf2db58e4c94775185
65 References
Daten bereitgestellt von Europe PubMed Central.
AUTHOR UNKNOWN, 0
Recalibration of temporal order perception by exposure to audio-visual asynchrony.
Vroomen J, Keetels M, de Gelder B, Bertelson P., Brain Res Cogn Brain Res 22(1), 2004
PMID: 15561498
Vroomen J, Keetels M, de Gelder B, Bertelson P., Brain Res Cogn Brain Res 22(1), 2004
PMID: 15561498
The nonlinear structure of motion perception during smooth eye movements.
Morvan C, Wexler M., J Vis 9(7), 2009
PMID: 19761316
Morvan C, Wexler M., J Vis 9(7), 2009
PMID: 19761316
Recalibration of perceived time across sensory modalities.
Hanson JV, Heron J, Whitaker D., Exp Brain Res 185(2), 2008
PMID: 18236035
Hanson JV, Heron J, Whitaker D., Exp Brain Res 185(2), 2008
PMID: 18236035
Rapid recalibration to audiovisual asynchrony.
Van der Burg E, Alais D, Cass J., J. Neurosci. 33(37), 2013
PMID: 24027264
Van der Burg E, Alais D, Cass J., J. Neurosci. 33(37), 2013
PMID: 24027264
Computational characterization of visually induced auditory spatial adaptation.
Wozny DR, Shams L., Front Integr Neurosci 5(), 2011
PMID: 22069383
Wozny DR, Shams L., Front Integr Neurosci 5(), 2011
PMID: 22069383
Recalibration of auditory space following milliseconds of cross-modal discrepancy.
Wozny DR, Shams L., J. Neurosci. 31(12), 2011
PMID: 21430160
Wozny DR, Shams L., J. Neurosci. 31(12), 2011
PMID: 21430160
Predicting auditory space calibration from recent multisensory experience.
Mendonca C, Escher A, van de Par S, Colonius H., Exp Brain Res 233(7), 2015
PMID: 25795081
Mendonca C, Escher A, van de Par S, Colonius H., Exp Brain Res 233(7), 2015
PMID: 25795081
Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities.
Bosen AK, Fleming JT, Allen PD, O'Neill WE, Paige GD., Exp Brain Res 235(2), 2016
PMID: 27837258
Bosen AK, Fleming JT, Allen PD, O'Neill WE, Paige GD., Exp Brain Res 235(2), 2016
PMID: 27837258
Multisensory simultaneity recalibration: storage of the aftereffect in the absence of counterevidence.
Machulla TK, Di Luca M, Froehlich E, Ernst MO., Exp Brain Res 217(1), 2011
PMID: 22207361
Machulla TK, Di Luca M, Froehlich E, Ernst MO., Exp Brain Res 217(1), 2011
PMID: 22207361
A model-based comparison of three theories of audiovisual temporal recalibration.
Yarrow K, Minaei S, Arnold DH., Cogn Psychol 83(), 2015
PMID: 26545105
Yarrow K, Minaei S, Arnold DH., Cogn Psychol 83(), 2015
PMID: 26545105
Opposite Effects of Recent History on Perception and Decision.
Fritsche M, Mostert P, de Lange FP., Curr. Biol. 27(4), 2017
PMID: 28162897
Fritsche M, Mostert P, de Lange FP., Curr. Biol. 27(4), 2017
PMID: 28162897
Hysteresis in the perception of motion direction as evidence for neural cooperativity.
Williams D, Phillips G, Sekuler R., Nature 324(6094), 1986
PMID: 3785395
Williams D, Phillips G, Sekuler R., Nature 324(6094), 1986
PMID: 3785395
Multi-timescale perceptual history resolves visual ambiguity.
Brascamp JW, Knapen TH, Kanai R, Noest AJ, van Ee R, van den Berg AV., PLoS ONE 3(1), 2008
PMID: 18231584
Brascamp JW, Knapen TH, Kanai R, Noest AJ, van Ee R, van den Berg AV., PLoS ONE 3(1), 2008
PMID: 18231584
Information processing in visual search: a continuous flow conception and experimental results.
Eriksen CW, Schultz DW., Percept Psychophys 25(4), 1979
PMID: 461085
Eriksen CW, Schultz DW., Percept Psychophys 25(4), 1979
PMID: 461085
Conflict monitoring and cognitive control.
Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD., Psychol Rev 108(3), 2001
PMID: 11488380
Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD., Psychol Rev 108(3), 2001
PMID: 11488380
Optimizing the use of information: strategic control of activation of responses.
Gratton G, Coles MG, Donchin E., J Exp Psychol Gen 121(4), 1992
PMID: 1431740
Gratton G, Coles MG, Donchin E., J Exp Psychol Gen 121(4), 1992
PMID: 1431740
Sequential dependencies in the Eriksen flanker task: a direct comparison of two competing accounts.
Davelaar EJ, Stevens J., Psychon Bull Rev 16(1), 2009
PMID: 19145021
Davelaar EJ, Stevens J., Psychon Bull Rev 16(1), 2009
PMID: 19145021
The Gratton effect remains after controlling for contingencies and stimulus repetitions.
Blais C, Stefanidi A, Brewer GA., Front Psychol 5(), 2014
PMID: 25386151
Blais C, Stefanidi A, Brewer GA., Front Psychol 5(), 2014
PMID: 25386151
Spatial attention and audiovisual interactions in apparent motion.
Sanabria D, Soto-Faraco S, Spence C., J Exp Psychol Hum Percept Perform 33(4), 2007
PMID: 17683238
Sanabria D, Soto-Faraco S, Spence C., J Exp Psychol Hum Percept Perform 33(4), 2007
PMID: 17683238
Capturing spatial attention with multisensory cues: a review.
Spence C, Santangelo V., Hear. Res. 258(1-2), 2009
PMID: 19409472
Spence C, Santangelo V., Hear. Res. 258(1-2), 2009
PMID: 19409472
Distinct Computational Principles Govern Multisensory Integration in Primary Sensory and Association Cortices.
Rohe T, Noppeney U., Curr. Biol. 26(4), 2016
PMID: 26853368
Rohe T, Noppeney U., Curr. Biol. 26(4), 2016
PMID: 26853368
Improvement of visual contrast detection by a simultaneous sound.
Lippert M, Logothetis NK, Kayser C., Brain Res. 1173(), 2007
PMID: 17765208
Lippert M, Logothetis NK, Kayser C., Brain Res. 1173(), 2007
PMID: 17765208
Sensory reliability shapes perceptual inference via two mechanisms.
Rohe T, Noppeney U., J Vis 15(5), 2015
PMID: 26067540
Rohe T, Noppeney U., J Vis 15(5), 2015
PMID: 26067540
Acoustic noise improves visual perception and modulates occipital oscillatory states.
Gleiss S, Kayser C., J Cogn Neurosci 26(4), 2013
PMID: 24236698
Gleiss S, Kayser C., J Cogn Neurosci 26(4), 2013
PMID: 24236698
0 + 1 > 1: How adding noninformative sound improves performance on a visual task.
Kim R, Peters MA, Shams L., Psychol Sci 23(1), 2011
PMID: 22127367
Kim R, Peters MA, Shams L., Psychol Sci 23(1), 2011
PMID: 22127367
Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations.
Kayser SJ, Philiastides MG, Kayser C., Neuroimage 148(), 2017
PMID: 28082107
Kayser SJ, Philiastides MG, Kayser C., Neuroimage 148(), 2017
PMID: 28082107
Conditional accuracy in response interference tasks: Evidence from the Eriksen flanker task and the spatial conflict task.
Stins JF, Polderman JC, Boomsma DI, de Geus EJ., Adv Cogn Psychol 3(3), 2008
PMID: 20517524
Stins JF, Polderman JC, Boomsma DI, de Geus EJ., Adv Cogn Psychol 3(3), 2008
PMID: 20517524
FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data.
Oostenveld R, Fries P, Maris E, Schoffelen JM., Comput Intell Neurosci 2011(), 2010
PMID: 21253357
Oostenveld R, Fries P, Maris E, Schoffelen JM., Comput Intell Neurosci 2011(), 2010
PMID: 21253357
Recipes for the linear analysis of EEG.
Parra LC, Spence CD, Gerson AD, Sajda P., Neuroimage 28(2), 2005
PMID: 16084117
Parra LC, Spence CD, Gerson AD, Sajda P., Neuroimage 28(2), 2005
PMID: 16084117
A supramodal accumulation-to-bound signal that determines perceptual decisions in humans.
O'Connell RG, Dockree PM, Kelly SP., Nat. Neurosci. 15(12), 2012
PMID: 23103963
O'Connell RG, Dockree PM, Kelly SP., Nat. Neurosci. 15(12), 2012
PMID: 23103963
Nonparametric statistical testing of EEG- and MEG-data.
Maris E, Oostenveld R., J. Neurosci. Methods 164(1), 2007
PMID: 17517438
Maris E, Oostenveld R., J. Neurosci. Methods 164(1), 2007
PMID: 17517438
Nonparametric permutation tests for functional neuroimaging: a primer with examples.
Nichols TE, Holmes AP., Hum Brain Mapp 15(1), 2002
PMID: 11747097
Nichols TE, Holmes AP., Hum Brain Mapp 15(1), 2002
PMID: 11747097
False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.
Simmons JP, Nelson LD, Simonsohn U., Psychol Sci 22(11), 2011
PMID: 22006061
Simmons JP, Nelson LD, Simonsohn U., Psychol Sci 22(11), 2011
PMID: 22006061
Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates.
Eklund A, Nichols TE, Knutsson H., Proc. Natl. Acad. Sci. U.S.A. 113(28), 2016
PMID: 27357684
Eklund A, Nichols TE, Knutsson H., Proc. Natl. Acad. Sci. U.S.A. 113(28), 2016
PMID: 27357684
Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: A simulation study.
Pernet CR, Latinus M, Nichols TE, Rousselet GA., J. Neurosci. Methods 250(), 2014
PMID: 25128255
Pernet CR, Latinus M, Nichols TE, Rousselet GA., J. Neurosci. Methods 250(), 2014
PMID: 25128255
Y, The Annals of Statistics 29(), 2001
Making sense of all the conflict: a theoretical review and critique of conflict-related ERPs.
Larson MJ, Clayson PE, Clawson A., Int J Psychophysiol 93(3), 2014
PMID: 24950132
Larson MJ, Clayson PE, Clawson A., Int J Psychophysiol 93(3), 2014
PMID: 24950132
The electrophysiological dynamics of interference during the Stroop task.
Hanslmayr S, Pastotter B, Bauml KH, Gruber S, Wimber M, Klimesch W., J Cogn Neurosci 20(2), 2008
PMID: 18275330
Hanslmayr S, Pastotter B, Bauml KH, Gruber S, Wimber M, Klimesch W., J Cogn Neurosci 20(2), 2008
PMID: 18275330
Event-related potential indices of congruency sequence effects without feature integration or contingency learning confounds.
Larson MJ, Clayson PE, Kirwan CB, Weissman DH., Psychophysiology 53(6), 2016
PMID: 26854028
Larson MJ, Clayson PE, Kirwan CB, Weissman DH., Psychophysiology 53(6), 2016
PMID: 26854028
Sounds reset rhythms of visual cortex and corresponding human visual perception.
Romei V, Gross J, Thut G., Curr. Biol. 22(9), 2012
PMID: 22503499
Romei V, Gross J, Thut G., Curr. Biol. 22(9), 2012
PMID: 22503499
Recalibration of audiovisual simultaneity.
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098
Event Related Potentials Index Rapid Recalibration to Audiovisual Temporal Asynchrony.
Simon DM, Noel JP, Wallace MT., Front Integr Neurosci 11(), 2017
PMID: 28381993
Simon DM, Noel JP, Wallace MT., Front Integr Neurosci 11(), 2017
PMID: 28381993
E, Audiovisual temporal recalibration occurs independently at two different time scales 5(), 2015
Can post-error dynamics explain sequential reaction time patterns?
Goldfarb S, Wong-Lin K, Schwemmer M, Leonard NE, Holmes P., Front Psychol 3(), 2012
PMID: 22811671
Goldfarb S, Wong-Lin K, Schwemmer M, Leonard NE, Holmes P., Front Psychol 3(), 2012
PMID: 22811671
Sequential effects in two-choice reaction time tasks: decomposition and synthesis of mechanisms.
Gao J, Wong-Lin K, Holmes P, Simen P, Cohen JD., Neural Comput 21(9), 2009
PMID: 19548803
Gao J, Wong-Lin K, Holmes P, Simen P, Cohen JD., Neural Comput 21(9), 2009
PMID: 19548803
Item-specific adaptation and the conflict-monitoring hypothesis: a computational model.
Blais C, Robidoux S, Risko EF, Besner D., Psychol Rev 114(4), 2007
PMID: 17907873
Blais C, Robidoux S, Risko EF, Besner D., Psychol Rev 114(4), 2007
PMID: 17907873
Specific activation of the V5 brain area by auditory motion processing: an fMRI study.
Poirier C, Collignon O, Devolder AG, Renier L, Vanlierde A, Tranduy D, Scheiber C., Brain Res Cogn Brain Res 25(3), 2005
PMID: 16298112
Poirier C, Collignon O, Devolder AG, Renier L, Vanlierde A, Tranduy D, Scheiber C., Brain Res Cogn Brain Res 25(3), 2005
PMID: 16298112
Capture of auditory motion by vision is represented by an activation shift from auditory to visual motion cortex.
Alink A, Singer W, Muckli L., J. Neurosci. 28(11), 2008
PMID: 18337398
Alink A, Singer W, Muckli L., J. Neurosci. 28(11), 2008
PMID: 18337398
Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing.
Sadaghiani S, Maier JX, Noppeney U., J. Neurosci. 29(20), 2009
PMID: 19458220
Sadaghiani S, Maier JX, Noppeney U., J. Neurosci. 29(20), 2009
PMID: 19458220
Tactile and visual motion direction processing in hMT+/V5.
van Kemenade BM, Seymour K, Wacker E, Spitzer B, Blankenburg F, Sterzer P., Neuroimage 84(), 2013
PMID: 24036354
van Kemenade BM, Seymour K, Wacker E, Spitzer B, Blankenburg F, Sterzer P., Neuroimage 84(), 2013
PMID: 24036354
Decoding sound and imagery content in early visual cortex.
Vetter P, Smith FW, Muckli L., Curr. Biol. 24(11), 2014
PMID: 24856208
Vetter P, Smith FW, Muckli L., Curr. Biol. 24(11), 2014
PMID: 24856208
The classic P300 encodes a build-to-threshold decision variable.
Twomey DM, Murphy PR, Kelly SP, O'Connell RG., Eur. J. Neurosci. 42(1), 2015
PMID: 25925534
Twomey DM, Murphy PR, Kelly SP, O'Connell RG., Eur. J. Neurosci. 42(1), 2015
PMID: 25925534
Conflict monitoring and anterior cingulate cortex: an update.
Botvinick MM, Cohen JD, Carter CS., Trends Cogn. Sci. (Regul. Ed.) 8(12), 2004
PMID: 15556023
Botvinick MM, Cohen JD, Carter CS., Trends Cogn. Sci. (Regul. Ed.) 8(12), 2004
PMID: 15556023
Anterior cingulate and prefrontal cortex: who's in control?
Cohen JD, Botvinick M, Carter CS., Nat. Neurosci. 3(5), 2000
PMID: 10769376
Cohen JD, Botvinick M, Carter CS., Nat. Neurosci. 3(5), 2000
PMID: 10769376
Conflict monitoring versus selection-for-action in anterior cingulate cortex.
Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD., Nature 402(6758), 1999
PMID: 10647008
Botvinick M, Nystrom LE, Fissell K, Carter CS, Cohen JD., Nature 402(6758), 1999
PMID: 10647008
Neural correlates of motor-sensory temporal recalibration.
Stekelenburg JJ, Sugano Y, Vroomen J., Brain Res. 1397(), 2011
PMID: 21600564
Stekelenburg JJ, Sugano Y, Vroomen J., Brain Res. 1397(), 2011
PMID: 21600564
The multifaceted interplay between attention and multisensory integration.
Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20675182
Talsma D, Senkowski D, Soto-Faraco S, Woldorff MG., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20675182
Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?
Talsma D, Doty TJ, Woldorff MG., Cereb. Cortex 17(3), 2006
PMID: 16707740
Talsma D, Doty TJ, Woldorff MG., Cereb. Cortex 17(3), 2006
PMID: 16707740
Selective attention modulates the direction of audio-visual temporal recalibration.
Ikumi N, Soto-Faraco S., PLoS ONE 9(7), 2014
PMID: 25004132
Ikumi N, Soto-Faraco S., PLoS ONE 9(7), 2014
PMID: 25004132
Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection.
Thut G, Nietzel A, Brandt SA, Pascual-Leone A., J. Neurosci. 26(37), 2006
PMID: 16971533
Thut G, Nietzel A, Brandt SA, Pascual-Leone A., J. Neurosci. 26(37), 2006
PMID: 16971533
On the role of prestimulus alpha rhythms over occipito-parietal areas in visual input regulation: correlation or causation?
Romei V, Gross J, Thut G., J. Neurosci. 30(25), 2010
PMID: 20573914
Romei V, Gross J, Thut G., J. Neurosci. 30(25), 2010
PMID: 20573914
Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain.
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M., Neuroimage 15(1), 2002
PMID: 11771995
Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M., Neuroimage 15(1), 2002
PMID: 11771995
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Quellen
PMID: 29487374
PubMed | Europe PMC
Suchen in