Visual attention during spatial language comprehension

Burigo M, Knoeferle P (2015)
PLoS ONE 10(1): e0115758.

Download
OA
Journal Article | Published | English
Abstract
Spatial terms such as “above”, “in front of”, and “on the left of” are all essential for describing the location of one object relative to another object in everyday communication. Apprehending such spatial relations involves relating linguistic to object representations by means of attention. This requires at least one attentional shift, and models such as the Attentional Vector Sum (AVS) predict the direction of that attention shift, from the sausage to the box for spatial utterances such as “The box is above the sausage”. To the extent that this prediction generalizes to overt gaze shifts, a listener’s visual attention should shift from the sausage to the box. However, listeners tend to rapidly look at referents in their order of mention and even anticipate them based on linguistic cues, a behavior that predicts a converse attentional shift from the box to the sausage. Four eye-tracking experiments assessed the role of overt attention in spatial language comprehension by examining to which extent visual attention is guided by words in the utterance and to which extent it also shifts “against the grain” of the unfolding sentence. The outcome suggests that comprehenders’ visual attention is predominantly guided by their interpretation of the spatial description. Visual shifts against the grain occurred only when comprehenders had some extra time, and their absence did not affect comprehension accuracy. However, the timing of this reverse gaze shift on a trial correlated with that trial’s verification time. Thus, while the timing of these gaze shifts is subtly related to the verification time, their presence is not necessary for successful verification of spatial relations
Publishing Year
ISSN
Financial disclosure
Article Processing Charge funded by the Deutsche Forschungsgemeinschaft and the Open Access Publication Fund of Bielefeld University.
PUB-ID

Cite this

Burigo M, Knoeferle P. Visual attention during spatial language comprehension. PLoS ONE. 2015;10(1): e0115758.
Burigo, M., & Knoeferle, P. (2015). Visual attention during spatial language comprehension. PLoS ONE, 10(1): e0115758.
Burigo, M., and Knoeferle, P. (2015). Visual attention during spatial language comprehension. PLoS ONE 10:e0115758.
Burigo, M., & Knoeferle, P., 2015. Visual attention during spatial language comprehension. PLoS ONE, 10(1): e0115758.
M. Burigo and P. Knoeferle, “Visual attention during spatial language comprehension”, PLoS ONE, vol. 10, 2015, : e0115758.
Burigo, M., Knoeferle, P.: Visual attention during spatial language comprehension. PLoS ONE. 10, : e0115758 (2015).
Burigo, Michele, and Knoeferle, Pia. “Visual attention during spatial language comprehension”. PLoS ONE 10.1 (2015): e0115758.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2016-02-26T06:56:40Z

This data publication is cited in the following publications:
This publication cites the following data publications:

64 References

Data provided by Europe PubMed Central.

Verification of text ideas during reading
AUTHOR UNKNOWN, 2006
Memory representations in natural tasks.
Ballard DH, Hayhoe MM, Pelz JB., J Cogn Neurosci 7(1), 1995
PMID: 23961754
Trade-offs between gaze and working memory use.
Droll JA, Hayhoe MM., J Exp Psychol Hum Percept Perform 33(6), 2007
PMID: 18085948
Mechanisms of visual attention revealed by saccadic eye movements.
Fischer B, Breitmeyer B., Neuropsychologia 25(1A), 1987
PMID: 3574652
Covert shifts of attention precede involuntary eye movements.
Peterson MS, Kramer AF, Irwin DE., Percept Psychophys 66(3), 2004
PMID: 15283065
Eye movements: the past 25 years.
Kowler E., Vision Res. 51(13), 2011
PMID: 21237189
Visual memory during pauses between successive saccades.
Gersch TM, Kowler E, Schnitzer BS, Dosher BA., J Vis 8(16), 2008
PMID: 19146281
Attention during sequences of saccades along marked and memorized paths.
Gersch TM, Kowler E, Schnitzer BS, Dosher BA., Vision Res. 49(10), 2009
PMID: 18226827
Attention during active visual tasks: counting, pointing, or simply looking.
Wilder JD, Kowler E, Schnitzer BS, Gersch TM, Dosher BA., Vision Res. 49(9), 2009
PMID: 18649913
The influence of recent scene events on spoken comprehension: Evidence from eye movements
AUTHOR UNKNOWN, 2007
Computational modelling of visual attention.
Itti L, Koch C., Nat. Rev. Neurosci. 2(3), 2001
PMID: 11256080
A theory of visual attention.
Bundesen C., Psychol Rev 97(4), 1990
PMID: 2247540
Looking, language, and memory: Bridging research from the visual world and visual search paradigms
AUTHOR UNKNOWN, 2011

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 25607540
PubMed | Europe PMC

Search this title in

Google Scholar