Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification

Knoeferle P, Urbach TP, Kutas M (2014)
Acta Psychologica 152: 133-148.

Download
OA
Journal Article | Published | English
Author
; ;
Abstract
Extant accounts of visually situated language processing do make general predictions about visual context effects on incremental sentence comprehension; these, however, are not sufficiently detailed to accommodate potentially different visual context effects (such as a scene-sentence mismatch based on actions versus thematic role relations, e.g., (Altmann & Kamide, 2007; Knoeferle & Crocker, 2007; Taylor & Zwaan, 2008; Zwaan & Radvansky, 1998)). To provide additional data for theory testing and development, we collected event-related brain potentials (ERPs) as participants read a subject-verb-object sentence (500 ms SOA in Experiment 1 and 300 ms SOA in Experiment 2), and post-sentence verification times indicating whether or not the verb and/or the thematic role relations matched a preceding picture (depicting two participants engaged in an action). Though incrementally processed, these two types of mismatch yielded different ERP effects. Role-relation mismatch effects emerged at the subject noun as anterior negativities to the mismatching noun, preceding action mismatch effects manifest as centro-parietal N400s greater to the mismatching verb, regardless of SOAs. These two types of mismatch manipulations also yielded different effects post-verbally, correlated differently with a participant's mean accuracy, verbal working memory and visual-spatial scores, and differed in their interactions with SOA. Taken together these results clearly implicate more than a single mismatch mechanism for extant accounts of picture-sentence processing to accommodate. (C) 2014 Elsevier B.V. All rights reserved.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Knoeferle P, Urbach TP, Kutas M. Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification. Acta Psychologica. 2014;152:133-148.
Knoeferle, P., Urbach, T. P., & Kutas, M. (2014). Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification. Acta Psychologica, 152, 133-148.
Knoeferle, P., Urbach, T. P., and Kutas, M. (2014). Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification. Acta Psychologica 152, 133-148.
Knoeferle, P., Urbach, T.P., & Kutas, M., 2014. Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification. Acta Psychologica, 152, p 133-148.
P. Knoeferle, T.P. Urbach, and M. Kutas, “Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification”, Acta Psychologica, vol. 152, 2014, pp. 133-148.
Knoeferle, P., Urbach, T.P., Kutas, M.: Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification. Acta Psychologica. 152, 133-148 (2014).
Knoeferle, Pia, Urbach, Thomas P., and Kutas, Marta. “Different mechanisms for role relations versus verb-action congruence effects: Evidence from ERPs in picture-sentence verification”. Acta Psychologica 152 (2014): 133-148.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2014-11-08 07:32:04

This data publication is cited in the following publications:
This publication cites the following data publications:

54 References

Data provided by Europe PubMed Central.

Monitoring in language perception
Van, Language and Linguistics Compass 1211–1224(), 2009
Monitoring in language perception: Evidence from ERPs in a picture–sentence matching task
Vissers, Neuropsychologia (), 2008
Thematic role assignment in patients with Broca's aphasia: Sentence–picture matching electrified
Wassenaar, Neuropsychologia 716–740(), 2007
Situations models in language comprehension and memory
Zwaan, Psychological Bulletin 162–185(), 1998

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 25216075
PubMed | Europe PMC

Search this title in

Google Scholar