Feedback and Surround Modulated Boundary Detection

Edges are key components of any visual scene to the extent that we can recognise objects merely by their silhouettes. The human visual system captures edge information through neurons in the visual cortex that are sensitive to both intensity discontinuities and particular orientations. The “classical approach” assumes that these cells are only responsive to the stimulus present within their receptive fields, however, recent studies demonstrate that surrounding regions and inter-areal feedback connections influence their responses significantly. In this work we propose a biologically-inspired edge detection model in which orientation selective neurons are represented through the first derivative of a Gaussian function resembling double-opponent cells in the primary visual cortex (V1). In our model we account for four kinds of receptive field surround, i.e. full, far, iso- and orthogonal-orientation, whose contributions are contrast-dependant. The output signal from V1 is pooled in its perpendicular direction by larger V2 neurons employing a contrast-variant centre-surround kernel. We further introduce a feedback connection from higher-level visual areas to the lower ones. The results of our model on three benchmark datasets show a big improvement compared to the current non-learning and biologically-inspired state-of-the-art algorithms while being competitive to the learning-based methods.

[1]  Tzvetomir Tzvetanov,et al.  Short- and long-range effects in line contrast integration , 2002, Vision Research.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Matthew F. Tang,et al.  The broad orientation dependence of the motion streak aftereffect reveals interactions between form and motion neurons. , 2015, Journal of vision.

[5]  Michael J. Black,et al.  Occlusion Boundary Detection via Deep Exploration of Context , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Alessandra Angelucci,et al.  Beyond the Classical Receptive Field : Surround Modulation in Primary Visual Cortex , 2022 .

[9]  Michael W. Spratling,et al.  Image Segmentation Using a Sparse Coding Model of Cortical Area V 1 , 2013 .

[10]  C. Alejandro Párraga,et al.  Biologically plausible boundary detection , 2016, BMVC.

[11]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Michael S. Landy,et al.  Texture analysis and perception , 2013 .

[14]  Christopher K. I. Williams,et al.  Visual Boundary Prediction: A Deep Neural Prediction Network and Quality Dissection , 2014, AISTATS.

[15]  Jianbo Shi,et al.  High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and Its Applications to High-Level Vision , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  M. Georgeson,et al.  Perception of stationary plaids: The role of spatial filters in edge analysis , 1997, Vision Research.

[17]  Kai-Fu Yang,et al.  Multifeature-Based Surround Inhibition Improves Contour Detection in Natural Images , 2014, IEEE Transactions on Image Processing.

[18]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Nicolas Thome,et al.  Cortical Networks of Visual Recognition , 2015 .

[20]  Eero P. Simoncelli,et al.  A functional and perceptual signature of the second visual area in primates , 2013, Nature Neuroscience.

[21]  Yongjie Li,et al.  Efficient Color Boundary Detection with Color-Opponent Mechanisms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[23]  Michael W. Spratling Image Segmentation Using a Sparse Coding Model of Cortical Area V1 , 2013, IEEE Transactions on Image Processing.

[24]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  H. Neumann,et al.  A recurrent model of contour integration in primary visual cortex. , 2008, Journal of vision.

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[28]  Alessandra Angelucci,et al.  Different Orientation Tuning of Near- and Far-Surround Suppression in Macaque Primary Visual Cortex Mirrors Their Tuning in Human Perception , 2013, The Journal of Neuroscience.

[29]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[30]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[31]  G Westheimer,et al.  Dynamics of spatial summation in primary visual cortex of alert monkeys. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[32]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[33]  Calvin C. Zhao Critical Review : Contour Detection and Hierarchical Image Segmentation , 2015 .

[34]  Jianbo Shi,et al.  DeepEdge: A multi-scale bifurcated deep network for top-down contour detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[36]  L. Spillmann,et al.  Beyond the classical receptive field: The effect of contextual stimuli. , 2015, Journal of vision.

[37]  C. Alejandro Parraga,et al.  Colour constancy as a product of dynamic centre-surround adaptation. , 2016 .

[38]  Gunter Loffler,et al.  Perception of contours and shapes: Low and intermediate stage mechanisms , 2008, Vision Research.

[39]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[40]  Thomas Serre,et al.  A systematic comparison between visual cues for boundary detection , 2016, Vision Research.

[41]  Li Fei-Fei,et al.  Simple line drawings suffice for functional MRI decoding of natural scene categories , 2011, Proceedings of the National Academy of Sciences.

[42]  L. Schwabe,et al.  Response facilitation from the "suppressive" receptive field surround of macaque V1 neurons. , 2007, Journal of neurophysiology.

[43]  Hui Wei,et al.  Contour detection model with multi-scale integration based on non-classical receptive field , 2013, Neurocomputing.

[44]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[45]  S. Zeki A vision of the brain , 1993 .

[46]  D. Field,et al.  Contour integration and the association field , 2013 .

[47]  J. B. Levitt,et al.  Comparison of Spatial Summation Properties of Neurons in Macaque V1 and V2 , 2009, Journal of neurophysiology.

[48]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  R. von der Heydt,et al.  Representation of object continuity in the visual cortex. , 2011, Journal of vision.

[50]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[51]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[52]  Kai-Fu Yang,et al.  Boundary Detection Using Double-Opponency and Spatial Sparseness Constraint , 2015, IEEE Transactions on Image Processing.

[53]  Francisco Javier Díaz Pernas,et al.  Double recurrent interaction V1-V2-V4 based neural architecture for color natural scene boundary detection and surface perception , 2014, Appl. Soft Comput..

[54]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[55]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[56]  Hugh R. Wilson,et al.  A biologically plausible model of human radial frequency perception , 2006, Vision Research.

[57]  Alexei A. Efros,et al.  Recovering Occlusion Boundaries from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[58]  Yongjie Li,et al.  A Color Constancy Model with Double-Opponency Mechanisms , 2013, 2013 IEEE International Conference on Computer Vision.

[59]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[60]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .