Visual attention during spatial language comprehension

Burigo M, Knoeferle P (2015)
PLoS ONE 10(1): e0115758.

Download
OA
Zeitschriftenaufsatz | Veröffentlicht | Englisch
Volltext vorhanden für diesen Nachweis
Abstract / Bemerkung
Spatial terms such as “above”, “in front of”, and “on the left of” are all essential for describing the location of one object relative to another object in everyday communication. Apprehending such spatial relations involves relating linguistic to object representations by means of attention. This requires at least one attentional shift, and models such as the Attentional Vector Sum (AVS) predict the direction of that attention shift, from the sausage to the box for spatial utterances such as “The box is above the sausage”. To the extent that this prediction generalizes to overt gaze shifts, a listener’s visual attention should shift from the sausage to the box. However, listeners tend to rapidly look at referents in their order of mention and even anticipate them based on linguistic cues, a behavior that predicts a converse attentional shift from the box to the sausage. Four eye-tracking experiments assessed the role of overt attention in spatial language comprehension by examining to which extent visual attention is guided by words in the utterance and to which extent it also shifts “against the grain” of the unfolding sentence. The outcome suggests that comprehenders’ visual attention is predominantly guided by their interpretation of the spatial description. Visual shifts against the grain occurred only when comprehenders had some extra time, and their absence did not affect comprehension accuracy. However, the timing of this reverse gaze shift on a trial correlated with that trial’s verification time. Thus, while the timing of these gaze shifts is subtly related to the verification time, their presence is not necessary for successful verification of spatial relations
Erscheinungsjahr
Zeitschriftentitel
PLoS ONE
Band
10
Ausgabe
1
Art.-Nr.
e0115758
ISSN
Finanzierungs-Informationen
Article Processing Charge funded by the Deutsche Forschungsgemeinschaft and the Open Access Publication Fund of Bielefeld University.
PUB-ID

Zitieren

Burigo M, Knoeferle P. Visual attention during spatial language comprehension. PLoS ONE. 2015;10(1): e0115758.
Burigo, M., & Knoeferle, P. (2015). Visual attention during spatial language comprehension. PLoS ONE, 10(1), e0115758. doi:10.1371/journal.pone.0115758
Burigo, M., and Knoeferle, P. (2015). Visual attention during spatial language comprehension. PLoS ONE 10:e0115758.
Burigo, M., & Knoeferle, P., 2015. Visual attention during spatial language comprehension. PLoS ONE, 10(1): e0115758.
M. Burigo and P. Knoeferle, “Visual attention during spatial language comprehension”, PLoS ONE, vol. 10, 2015, : e0115758.
Burigo, M., Knoeferle, P.: Visual attention during spatial language comprehension. PLoS ONE. 10, : e0115758 (2015).
Burigo, Michele, and Knoeferle, Pia. “Visual attention during spatial language comprehension”. PLoS ONE 10.1 (2015): e0115758.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:29Z

1 Zitation in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Spatial language and converseness.
Burigo M, Coventry KR, Cangelosi A, Lynott D., Q J Exp Psychol (Hove) 69(12), 2016
PMID: 26911205

64 References

Daten bereitgestellt von Europe PubMed Central.


AUTHOR UNKNOWN, 1976

AUTHOR UNKNOWN, 2004
How language structures space
AUTHOR UNKNOWN, 1983
Attention and spatial language
AUTHOR UNKNOWN, 2005
Spatial attention and the apprehension of spatial relations.
Logan GD., J Exp Psychol Hum Percept Perform 20(5), 1994
PMID: 7964527
Flexible visual processing of spatial relationships.
Franconeri SL, Scimeca JM, Roth JC, Helseth SA, Kahn LE., Cognition 122(2), 2011
PMID: 22119165
Perceiving spatial relations via attentional tracking and shifting.
Holcombe AO, Linares D, Vaziri-Pashkam M., Curr. Biol. 21(13), 2011
PMID: 21703857
Attentional coding of categorical relations in scene perception: evidence from the flicker paradigm.
Rosielle LJ, Crabb BT, Cooper EE., Psychon Bull Rev 9(2), 2002
PMID: 12120795
Spatial language, visual attention, and perceptual simulation.
Coventry KR, Lynott D, Cangelosi A, Monrouxe L, Joyce D, Richardson DC., Brain Lang 112(3), 2009
PMID: 19664814
Circumscribing referential domains during real-time language comprehension
AUTHOR UNKNOWN, 2002
Integration of visual and linguistic information in spoken language comprehension.
Tanenhaus MK, Spivey-Knowlton MJ, Eberhard KM, Sedivy JC., Science 268(5217), 1995
PMID: 7777863
Eye movements as a window into real-time spoken language comprehension in natural contexts.
Eberhard KM, Spivey-Knowlton MJ, Sedivy JC, Tanenhaus MK., J Psycholinguist Res 24(6), 1995
PMID: 8531168
Attention and spatial language
AUTHOR UNKNOWN, 2005
Attention unites form and function in spatial language
AUTHOR UNKNOWN, 2006
Serial deployment of attention during visual search.
Woodman GF, Luck SJ., J Exp Psychol Hum Percept Perform 29(1), 2003
PMID: 12669752
Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models
AUTHOR UNKNOWN, 1998
The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing
AUTHOR UNKNOWN, 1974
I see what you're saying: the integration of complex speech and scenes during language comprehension.
Andersson R, Ferreira F, Henderson JM., Acta Psychol (Amst) 137(2), 2011
PMID: 21303711
Eye movements as a window into real-time spoken language comprehension in natural contexts.
Eberhard KM, Spivey-Knowlton MJ, Sedivy JC, Tanenhaus MK., J Psycholinguist Res 24(6), 1995
PMID: 8531168
Neuronal population coding of movement direction.
Georgopoulos AP, Schwartz AB, Kettner RE., Science 233(4771), 1986
PMID: 3749885
A computational analysis of the apprehension of spatial relations
AUTHOR UNKNOWN, 1996
On the process of comparing sentences against pictures
AUTHOR UNKNOWN, 1972
Grammatical transformations and speed of understanding
AUTHOR UNKNOWN, 1965
The Interplay between Geometry and Function in the Comprehension of ‘Over’, ‘Under’, ‘Above’, and ‘Below’
AUTHOR UNKNOWN, 2001
Neural correlates of spatial term use.
Carlson LA, West R, Taylor HA, Herndon RW., J Exp Psychol Hum Percept Perform 28(6), 2002
PMID: 12542134
Distance and distraction effects in the apprehension of spatial relations.
Logan GD, Compton BJ., J Exp Psychol Hum Percept Perform 22(1), 1996
PMID: 8742259
Time course of frequency effects in spoken-word recognition: evidence from eye movements.
Dahan D, Magnuson JS, Tanenhaus MK., Cogn Psychol 42(4), 2001
PMID: 11368527

AUTHOR UNKNOWN, 2008

AUTHOR UNKNOWN, 2007
Fitting linear mixed models in R
AUTHOR UNKNOWN, 2005

AUTHOR UNKNOWN, 2007
Random effects structure for confirmatory hypothesis testing: Keep it maximal.
Barr DJ, Levy R, Scheepers C, Tily HJ., J Mem Lang 68(3), 2013
PMID: 24403724
Random slope in LME
AUTHOR UNKNOWN, 2011
Centring in regression analyses: a strategy to prevent errors in statistical inference.
Kraemer HC, Blasey CM., Int J Methods Psychiatr Res 13(3), 2004
PMID: 15297898
Priming ditransitive structures in comprehension.
Arai M, van Gompel RP, Scheepers C., Cogn Psychol 54(3), 2006
PMID: 16973144
Syntactic priming in comprehension: the role of argument order and animacy.
Carminati MN, van Gompel RP, Scheepers C, Arai M., J Exp Psychol Learn Mem Cogn 34(5), 2008
PMID: 18763894
What works with individuals in a clinical setting?
Faccio E., Front Psychol 2(), 2011
PMID: 21738514
Response latencies in judgements of spatial location.
Seymour PH., Br J Psychol 60(1), 1969
PMID: 5779026

AUTHOR UNKNOWN, 1967
A goal-based perspective on eye movements in visual world studies.
Salverda AP, Brown M, Tanenhaus MK., Acta Psychol (Amst) 137(2), 2010
PMID: 21067708
The span of the effective stimulus during a fixation in reading
AUTHOR UNKNOWN, 1975
Memory for relational information across eye movements.
Carlson-Radvansky LA., Percept Psychophys 61(5), 1999
PMID: 10499004
Verification of text ideas during reading
AUTHOR UNKNOWN, 2006
Memory representations in natural tasks.
Ballard DH, Hayhoe MM, Pelz JB., J Cogn Neurosci 7(1), 1995
PMID: 23961754
Trade-offs between gaze and working memory use.
Droll JA, Hayhoe MM., J Exp Psychol Hum Percept Perform 33(6), 2007
PMID: 18085948
Mechanisms of visual attention revealed by saccadic eye movements.
Fischer B, Breitmeyer B., Neuropsychologia 25(1A), 1987
PMID: 3574652
Covert shifts of attention precede involuntary eye movements.
Peterson MS, Kramer AF, Irwin DE., Percept Psychophys 66(3), 2004
PMID: 15283065
Eye movements: the past 25 years.
Kowler E., Vision Res. 51(13), 2011
PMID: 21237189
Visual memory during pauses between successive saccades.
Gersch TM, Kowler E, Schnitzer BS, Dosher BA., J Vis 8(16), 2008
PMID: 19146281
Attention during sequences of saccades along marked and memorized paths.
Gersch TM, Kowler E, Schnitzer BS, Dosher BA., Vision Res. 49(10), 2008
PMID: 18226827
Attention during active visual tasks: counting, pointing, or simply looking.
Wilder JD, Kowler E, Schnitzer BS, Gersch TM, Dosher BA., Vision Res. 49(9), 2008
PMID: 18649913
The influence of recent scene events on spoken comprehension: Evidence from eye movements
AUTHOR UNKNOWN, 2007
Computational modelling of visual attention.
Itti L, Koch C., Nat. Rev. Neurosci. 2(3), 2001
PMID: 11256080
A theory of visual attention.
Bundesen C., Psychol Rev 97(4), 1990
PMID: 2247540
Looking, language, and memory: bridging research from the visual world and visual search paradigms.
Huettig F, Olivers CN, Hartsuiker RJ., Acta Psychol (Amst) 137(2), 2010
PMID: 20817134

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

Quellen

PMID: 25607540
PubMed | Europe PMC

Suchen in

Google Scholar