Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-base...

"To decide "Where to look next ?" is a central function of the attention system of humans, animals and robots. Control of attention depends on three factors, that is, low-level static and dynamic visual features of the environment (bottom-up), medium-level visual features of proto-objects and the task (top-down). We present a novel integrated computational model that includes all these factors in a coherent architecture based on findings and constraints from the primate visual system. ... "

 

 

Sent to you by Frouke via Google Reader:

 

 

Where to Look Next? Combining Static and Dynamic Proto-objects in a TVA-based Model of Visual Attention

via Cognitive Computation (Online First™) on 11/6/10

Abstract  

To decide "Where to look next ?" is a central function of the attention system of humans, animals and robots. Control of attention depends on three factors, that is, low-level static and dynamic visual features of the environment (bottom-up), medium-level visual features of proto-objects and the task (top-down). We present a novel integrated computational model that includes all these factors in a coherent architecture based on findings and constraints from the primate visual system. The model combines spatially inhomogeneous processing of static features, spatio-temporal motion features and task-dependent priority control in the form of the first computational implementation of saliency computation as specified by the "Theory of Visual Attention" (TVA, [7]). Importantly, static and dynamic processing streams are fused at the level of visual proto-objects, that is, ellipsoidal visual units that have the additional medium-level features of position, size, shape and orientation of the principal axis. Proto-objects serve as input to the TVA process that combines top-down and bottom-up information for computing attentional priorities so that relatively complex search tasks can be implemented. To this end, separately computed static and dynamic proto-objects are filtered and subsequently merged into one combined map of proto-objects. For each proto-object, attentional priorities in the form of attentional weights are computed according to TVA. The target of the next saccade is the center of gravity of the proto-object with the highest weight according to the task. We illustrate the approach by applying it to several real world image sequences and show that it is robust to parameter variations.

• Content Type Journal Article
• DOI 10.1007/s12559-010-9080-1
• Authors
  • Marco Wischnewski, Center of Excellence - Cognitive Interaction Technology (CITEC) and Neuro-cognitive Psychology, Bielefeld University, Bielefeld, Northrhine-Westphalia, Germany
  • Anna Belardinelli, Center of Excellence - Cognitive Interaction Technology (CITEC) and Neuro-cognitive Psychology, Bielefeld University, Bielefeld, Northrhine-Westphalia, Germany
  • Werner X. Schneider, Center of Excellence - Cognitive Interaction Technology (CITEC) and Neuro-cognitive Psychology, Bielefeld University, Bielefeld, Northrhine-Westphalia, Germany
  • Jochen J. Steil, Research Institute for Cognition and Robotics (CoR-Lab) & Faculty of Technology, Bielefeld University, Bielefeld, Northrhine-Westphalia, Germany

• Journal Cognitive Computation
• Online ISSN 1866-9964
• Print ISSN 1866-9956

 

 

Things you can do from here:

• Subscribe to Cognitive Computation (Online First™) using Google Reader
• Get started using Google Reader to easily keep up with all your favorite sites