Hierarchical visual attention model for saliency detection inspired by avian visual pathways

Visual attention is a mechanism that enables the visual system to detect potentially important objects in complex environment. Most computational visual attention models are designed with inspirations from mammalian visual systems. However, electrophysiological and behavioral evidences indicate that avian species are animals with high visual capability that can process complex information accurately in real time. Therefore, the visual system of the avian species, especially the nuclei related to the visual attention mechanism, are investigated in this paper. Afterwards, a hierarchical visual attention model is proposed for saliency detection. The optic tectum neuron responses are computed and the self-information is used to compute primary saliency maps in the first hierarchy. The “ winner-take-all ” network in the tecto-isthmal projection is simulated and final saliency maps are estimated with the regularized random walks ranking in the second hierarchy. Comparison results verify that the proposed model, which can define the focus of attention accurately, outperforms several state-of-the-art models. This study provides insights into the relationship between the visual attention mechanism and the avian visual pathways. The computational visual attention model may reveal the underlying neural mechanism of the nuclei for biological visual attention.

[1]  G. Rees,et al.  Saccades Differentially Modulate Human LGN and V1 Responses in the Presence and Absence of Visual Stimulation , 2005, Current Biology.

[2]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[3]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[4]  Qing Wang,et al.  Asynchronous H∞ control for unmanned aerial vehicles: switched polytopic system approach , 2015, IEEE/CAA Journal of Automatica Sinica.

[5]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[6]  Hermann Wagner,et al.  From optics to attention: visual perception in barn owls , 2011, Journal of Comparative Physiology A.

[7]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[8]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[9]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[12]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[13]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  R. Shlaer An Eagle's Eye: Quality of the Retinal Image , 1972, Science.

[15]  Ohad Ben-Shahar,et al.  Visual pop-out in barn owls: Human-like behavior in the avian brain. , 2015, Journal of vision.

[16]  J. Pakan,et al.  The optic tectum of birds: mapping our way to understanding visual processing. , 2009, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[17]  Fang Liu,et al.  Biological eagle-eye - Based visual imaging guidance simulation platform for unmanned flying vehicles , 2013, IEEE Aerospace and Electronic Systems Magazine.

[18]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[19]  H. Mueller Factors influencing prey selection in the American kestrel , 1974 .

[20]  Emily K. Leiker,et al.  Figure–ground discrimination in the avian brain: The nucleus rotundus and its inhibitory complex , 2012, Vision Research.

[21]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[22]  B. Frost,et al.  Magnocellular and parvocellular divisions of pigeon nucleus isthmi differentially modulate visual responses in the tectum , 2004, Experimental Brain Research.

[23]  H. Karten,et al.  Centrifugal projections upon the retina: An anterograde tracing study in the pigeon (Columba livia) , 1995, The Journal of comparative neurology.

[24]  Ehud Rivlin,et al.  Through a barn owl’s eyes: interactions between scene content and visual attention , 2008, Biological Cybernetics.

[25]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[26]  Haibin Duan,et al.  Visual Attention Model Based on Statistical Properties of Neuron Responses , 2015, Scientific Reports.

[27]  Xiaohong Su,et al.  UAV online path planning algorithm in a low altitude dangerous environment , 2015, IEEE/CAA Journal of Automatica Sinica.

[28]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  B. J. Frost,et al.  Visual response characteristics of neurons in the nucleus isthmi magnocellularis and nucleus isthmi parvocellularis of pigeons , 2004, Experimental Brain Research.

[30]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[31]  Zhaoping Li,et al.  Feature-specific interactions in salience from combined feature contrasts: evidence for a bottom-up saliency map in V1. , 2007, Journal of vision.

[32]  Xiaohua Wang,et al.  Small and Dim Target Detection via Lateral Inhibition Filtering and Artificial Bee Colony Based Selective Visual Attention , 2013, PloS one.

[33]  Ohad Ben-Shahar,et al.  Overt attention toward oriented objects in free-viewing barn owls , 2011, Proceedings of the National Academy of Sciences.

[34]  J. Wild,et al.  A pathway for predation in the brain of the barn owl (Tyto alba): Projections of the gracile nucleus to the “claw area” of the rostral wulst via the dorsal thalamus , 2008, The Journal of comparative neurology.

[35]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Ivan N Pigarev,et al.  Neural Mechanisms of Visual Attention: How Top-Down Feedback Highlights Relevant Locations , 2007, Science.

[37]  Hermann Wagner,et al.  Responses of Tectal Neurons to Contrasting Stimuli: An Electrophysiological Study in the Barn Owl , 2012, PloS one.

[38]  D. Blough,et al.  Feature-based search asymmetries in pigeons and humans , 1989, Perception & psychophysics.

[39]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[40]  D. Bird,et al.  Retinotopic representation of the bifoveate eye of the kestrel (Falco sparverius) on the optic tectum , 1990, Visual Neuroscience.

[41]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[45]  H. Bischof,et al.  On the structure and function of the tectofugal visual pathway in laterally eyed birds. , 1997, European journal of morphology.

[46]  David Dagan Feng,et al.  Robust saliency detection via regularized random walks ranking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Gustavo Deco,et al.  Attention in natural scenes: Neurophysiological and computational bases , 2006, Neural Networks.

[48]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Eric I. Knudsen,et al.  Global Inhibition and Stimulus Competition in the Owl Optic Tectum , 2010, The Journal of Neuroscience.

[50]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[51]  Wei Zheng,et al.  Robust and accurate monocular visual navigation combining IMU for a quadrotor , 2015, IEEE/CAA Journal of Automatica Sinica.

[52]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.