Oriented edge-selective band-pass filtering

Edge orientations play an important role in recognition due to their function as a primitive visual feature for various kinds of recognition tasks. Filter-based schemes are the most well-known and widely used method for analyzing edge orientation. However, the classical filter-based approach passes not only edges inside the preferred orientation band, but also edges outside the band. This can cause ambiguity in the estimation of edge orientation and can subsequently lead to failure in recognition tasks where edge orientations are used as a primitive feature. In this paper, we propose a novel filtering scheme, referred to as oriented edge-selective band-pass filtering, which passes edges inside the preferred orientation band and prevents edges outside the band from passing through. We present a computational model based on the basic mechanisms of cortical processing, i.e., a recurrent framework integrating the feedforward, lateral, and feedback processes, with the aim of investigating a solution based on the psychophysical and neuro-physiological findings of several decades. In the feedforward stage, our model employs a classical filter-based method to allow as many edges as possible in the preferred orientation band to pass through, while also allowing some edges outside the band to pass. The responses of edges outside the band are then inhibited by recurrent processing, involving two steps: a lateral and a feedback stage. We evaluated the performance of our model against classical filter-based methods, such as Gabor and Neumann filtering, using several artificial and natural images. The results validated the effectiveness of our approach.

[1]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[2]  J. B. Levitt,et al.  A model for the intracortical origin of orientation preference and tuning in macaque striate cortex , 1999, Visual Neuroscience.

[3]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[4]  Guillaume S Masson,et al.  Object motion computation for the initiation of smooth pursuit eye movements in humans. , 2005, Journal of neurophysiology.

[5]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[6]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[7]  K. Grieve,et al.  Effects of feedback projections from area 18 layers 2/3 to area 17 layers 2/3 in the cat visual cortex. , 1999, Journal of neurophysiology.

[8]  Keiko Tanaka,et al.  Analysis of Development of Direction Selectivity in Retinotectum by a Neural Circuit Model with Spike Timing-Dependent Plasticity , 2011, The Journal of Neuroscience.

[9]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Carl-Fredrik Westin,et al.  Representing Local Structure Using Tensors II , 2011, SCIA.

[11]  Mark Johnston,et al.  A novel particle swarm optimisation approach to detecting continuous, thin and smooth edges in noisy images , 2013, Inf. Sci..

[12]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Hans Knutsson,et al.  Representing Pairs of Orientations in the Plane , 2007, SCIA.

[14]  Heiko Neumann,et al.  Interaction of ON and OFF pathways for visual contrast measurement , 2008, Biological Cybernetics.

[15]  Nicolai Petkov,et al.  Adaptive Pseudo Dilation for Gestalt Edge Grouping and Contour Detection , 2008, IEEE Transactions on Image Processing.

[16]  Benjamin B. Kimia,et al.  Image segmentation by reaction-diffusion bubbles , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  M. Shiffrar,et al.  Increased Motion Linking Across Edges with Decreased Luminance Contrast, Edge Width and Duration , 1996, Vision Research.

[18]  Haim Sompolinsky,et al.  Chaos and synchrony in a model of a hypercolumn in visual cortex , 1996, Journal of Computational Neuroscience.

[19]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[20]  Til Aach,et al.  Histogram-based orientation analysis for junctions , 2006, 2006 14th European Signal Processing Conference.

[21]  Hans Supèr,et al.  Feedback Enhances Feedforward Figure-Ground Segmentation by Changing Firing Mode , 2011, PloS one.

[22]  T. Sanger,et al.  Stereo disparity computation using Gabor filters , 1988, Biological Cybernetics.

[23]  Sushmita Mitra,et al.  Satellite image segmentation with Shadowed C-Means , 2011, Inf. Sci..

[24]  Xiaofeng Ren,et al.  Multi-scale Improves Boundary Detection in Natural Images , 2008, ECCV.

[25]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[26]  Iain D Gilchrist,et al.  Oculomotor capture by transient events: a comparison of abrupt onsets, offsets, motion, and flicker. , 2008, Journal of vision.

[27]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Agustín Trujillo-Pino,et al.  Accurate subpixel edge location based on partial area effect , 2013, Image Vis. Comput..

[29]  Nicolai Petkov,et al.  Edge and line oriented contour detection: State of the art , 2011, Image Vis. Comput..

[30]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Jane You,et al.  Visual query processing for efficient image retrieval using a SOM-based filter-refinement scheme , 2012, Inf. Sci..

[32]  Jitendra Malik,et al.  Detecting and localizing edges composed of steps, peaks and roofs , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[33]  Bartlett W. Mel SEEMORE: Combining Color, Shape, and Texture Histogramming in a Neurally Inspired Approach to Visual Object Recognition , 1997, Neural Computation.

[34]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[35]  S. Grossberg,et al.  A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning. , 2010, Cerebral cortex.

[36]  Suzanne P. McKee,et al.  Constraints on long range interactions mediating contour detection , 1998, Vision Research.

[37]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[38]  M. Van Ginkel,et al.  Image analysis using orientation space based on steerable filters , 2002 .

[39]  H. Neumann,et al.  A recurrent model of contour integration in primary visual cortex. , 2008, Journal of vision.

[40]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Thomas Brox,et al.  Nonlinear structure tensors , 2006, Image Vis. Comput..

[42]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[43]  Il Hong Suh,et al.  Lateral and feedback schemes for the inhibition of false-positive responses in edge orientation channels , 2012, 2012 IEEE International Conference on Robotics and Automation.

[44]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[45]  Tony Lindeberg,et al.  Shape from texture from a multi-scale perspective , 1993, 1993 (4th) International Conference on Computer Vision.

[46]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[47]  Tae-Seong Kim,et al.  Content-based facial image retrieval using constrained independent component analysis , 2011, Inf. Sci..

[48]  Joost van de Weijer,et al.  Adaptive Structure Tensors and their Applications , 2006, Visualization and Processing of Tensor Fields.

[49]  Yacov Hel-Or,et al.  Canonical Decomposition of Steerable Functions , 2004, Journal of Mathematical Imaging and Vision.

[50]  Tianxu Zhang,et al.  Contour detection based on contextual influences , 2007, Image Vis. Comput..

[51]  Kurt Keutzer,et al.  Efficient, high-quality image contour detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[52]  Michael W. Spratling,et al.  A Feedback Model of Visual Attention , 2004, Journal of Cognitive Neuroscience.

[53]  Martin D. Levine,et al.  Human activity recognition in videos using a single example , 2013, Image Vis. Comput..

[54]  Gerald Sommer,et al.  Junction classification by multiple orientation detection , 1994, ECCV.

[55]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[56]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Pietro Perona Steerable-scalable kernels for edge detection and junction analysis , 1992, Image Vis. Comput..

[58]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[59]  Tai Sing Lee,et al.  A unified model of spatial and object attention based on inter-cortical biased competition , 2002, Neurocomputing.

[60]  Antonis A. Argyros,et al.  Integrating tracking with fine object segmentation , 2013, Image Vis. Comput..

[61]  Xin Wang,et al.  Laplacian Operator-Based Edge Detectors , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  C. Acuña,et al.  Discrimination of line orientation in humans and monkeys. , 2000, Journal of neurophysiology.

[63]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[64]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[65]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[66]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[67]  N. Zhang,et al.  Multiscale roughness measure for color image segmentation , 2012, Inf. Sci..

[68]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[69]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[70]  Charles D. Gilbert,et al.  Lateral interactions in visual cortex. , 1990, Cold Spring Harbor symposia on quantitative biology.

[71]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[72]  Luis Miguel Bergasa,et al.  Gauge-SURF descriptors , 2013, Image Vis. Comput..