Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention

Wischnewski M, Belardinelli A, Schneider WX, Steil JJ (2010)
Cognitive Computation 2(4): 326-343.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Abstract / Bemerkung
To decide "Where to look next ?" is a central function of the attention system of humans, animals and robots. Control of attention depends on three factors, that is, low-level static and dynamic visual features of the environment (bottom-up), medium-level visual features of proto-objects and the task (top-down). We present a novel integrated computational model that includes all these factors in a coherent architecture based on findings and constraints from the primate visual system. The model combines spatially inhomogeneous processing of static features, spatio-temporal motion features and task-dependent priority control in the form of the first computational implementation of saliency computation as specified by the "Theory of Visual Attention" (TVA, [7]). Importantly, static and dynamic processing streams are fused at the level of visual proto-objects, that is, ellipsoidal visual units that have the additional medium-level features of position, size, shape and orientation of the principal axis. Proto-objects serve as input to the TVA process that combines top-down and bottom-up information for computing attentional priorities so that relatively complex search tasks can be implemented. To this end, separately computed static and dynamic proto-objects are filtered and subsequently merged into one combined map of proto-objects. For each proto-object, attentional priorities in the form of attentional weights are computed according to TVA. The target of the next saccade is the center of gravity of the proto-object with the highest weight according to the task. We illustrate the approach by applying it to several real world image sequences and show that it is robust to parameter variations.
Stichworte
TVA; Modeling visual attention; Proto-objects; Static and dynamic features; Inhomogeneity; Top-down control; Natural scenes
Erscheinungsjahr
2010
Zeitschriftentitel
Cognitive Computation
Band
2
Ausgabe
4
Seite(n)
326-343
ISSN
1866-9956
eISSN
1866-9964
Page URI
https://pub.uni-bielefeld.de/record/1928034

Zitieren

Wischnewski M, Belardinelli A, Schneider WX, Steil JJ. Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention. Cognitive Computation. 2010;2(4):326-343.
Wischnewski, M., Belardinelli, A., Schneider, W. X., & Steil, J. J. (2010). Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention. Cognitive Computation, 2(4), 326-343. https://doi.org/10.1007/s12559-010-9080-1
Wischnewski, Marco, Belardinelli, Anna, Schneider, Werner X., and Steil, Jochen J. 2010. “Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention”. Cognitive Computation 2 (4): 326-343.
Wischnewski, M., Belardinelli, A., Schneider, W. X., and Steil, J. J. (2010). Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention. Cognitive Computation 2, 326-343.
Wischnewski, M., et al., 2010. Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention. Cognitive Computation, 2(4), p 326-343.
M. Wischnewski, et al., “Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention”, Cognitive Computation, vol. 2, 2010, pp. 326-343.
Wischnewski, M., Belardinelli, A., Schneider, W.X., Steil, J.J.: Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention. Cognitive Computation. 2, 326-343 (2010).
Wischnewski, Marco, Belardinelli, Anna, Schneider, Werner X., and Steil, Jochen J. “Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention”. Cognitive Computation 2.4 (2010): 326-343.
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Suchen in

Google Scholar