Multi-scale keypoints in V1 and beyond: object segregation, scale selection, saliency maps and face detection.

End-stopped cells in cortical area V1, which combine outputs of complex cells tuned to different orientations, serve to detect line and edge crossings, singularities and points with large curvature. These cells can be used to construct retinotopic keypoint maps at different spatial scales (level-of-detail). The importance of the multi-scale keypoint representation is studied in this paper. It is shown that this representation provides very important information for object recognition and face detection. Different grouping operators can be used for object segregation and automatic scale selection. Saliency maps for focus-of-attention can be constructed. Such maps can be employed for face detection by grouping facial landmarks at eyes, nose and mouth. Although a face detector can be based on processing within area V1, it is argued that such an operator must be embedded into dorsal and ventral data streams, to and from higher cortical areas, for obtaining translation-, rotation- and scale-invariant detection.

[1]  D. Hubel.  Eye, brain, and vision , 1988 .

[2]  João M. F. Rodrigues,et al.  Multi-scale Keypoints in V1 and Face Detection , 2005, BVAI.

[3]  Rolf P. Würtz,et al.  Extraction And Matching Of Symbolic Contour Graphs , 2003, Int. J. Pattern Recognit. Artif. Intell..

[4]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[5]  Hiroaki Kitano,et al.  Graph extraction from color images , 2001, ESANN.

[6]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[7]  Erhardt Barth,et al.  Endstopped operators based on iterated nonlinear center-surround inhibition , 1998, Electronic Imaging.

[8]  Tong Tang,et al.  Proceedings of the European Symposium on Artificial Neural Networks , 2006 .

[9]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[10]  M. Bar.  A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[11]  Heiko Neumann,et al.  Recurrent Long-Range Interactions in Early Vision , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[12]  Rolf P. Würtz,et al.  Object Recognition by Matching Symbolic Edge Graphs , 1998, ACCV.

[13]  Ronald A. Rensink.  The Dynamic Representation of Scenes , 2000 .

[14]  Rolf P. Würtz,et al.  Corner detection in color images through a multiscale combination of end-stopped cortical cells , 2000, Image Vis. Comput..

[15]  Rüdiger von der Heydt,et al.  Detection of General Edges and Keypoints , 1992, ECCV.

[16]  V. Bruce,et al.  Visual perception: physiology, psychology and ecology. Fourth edition , 2003 .

[17]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[18]  João M. F. Rodrigues,et al.  Visual Cortex Frontend: Integrating Lines, Edges, Keypoints, and Disparity , 2004, ICIAR.

[19]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[20]  Zhaoping Li.  V1 mechanisms and some figure-ground and border effects. , 2003, Journal of physiology, Paris.

[21]  Carlo Tomasi,et al.  Edge, Junction, and Corner Detection Using Color Distributions , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  N. Drasdo.  Eye, brain, and vision David H. Hubel Scientific American Library Book — distributed by W. H. Freeman, New York, £15.95 , 1990 .

[23]  Olof Henricsson,et al.  The Role of Key-Points in Finding Contours , 1994, ECCV.

[24]  Rolf P. Würtz,et al.  Corner Detection in Color Images by Multiscale Combination of End-Stopped Cortical Cells , 1997, ICANN.

[25]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[26]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[27]  Nicolai Petkov,et al.  Lateral inhibition in cortical filters , 1993 .

[28]  João M. F. Rodrigues,et al.  A vision fronted with a new disparity model , 2004 .

[29]  Heinrich H. Bülthoff,et al.  Proceedings of the First IEEE International Workshop on Biologically Motivated Computer Vision , 2000 .

[30]  Hiroaki Kitano,et al.  Automatic graph extraction from color images , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[31]  Olaf Kübler,et al.  Simulation of neural contour mechanisms: from simple to end-stopped cells , 1992, Vision Research.

[32]  J. M. Hans du Buf,et al.  Responses of simple cells: events, interferences, and ambiguities , 1993, Biological Cybernetics.

[33]  James H. Elder,et al.  Psychophysical receptive fields of edge detection mechanisms , 2004, Vision Research.

[34]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  João M. F. Rodrigues,et al.  Multi-scale Cortical Keypoint Representation for Attention and Object Detection , 2005, IbPRIA.

[36]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[37]  Heiko Neumann,et al.  A Biologically Motivated Scheme for Robust Junction Detection , 2002, Biologically Motivated Computer Vision.

[38]  J. M. Hans du Buf,et al.  Simultaneous Detection of Lines and Edges Using Compound Gabor Filters , 2000, Int. J. Pattern Recognit. Artif. Intell..

[39]  Bill Triggs,et al.  Detecting Keypoints with Stable Position, Orientation, and Scale under Illumination Changes , 2004, ECCV.

[40]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[42]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[43]  Christoph Rasche.  The Making of a Neuromorphic Visual System , 2004 .

[44]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[45]  M. Land.  Visual Perception: Physiology, Psychology and Ecology, Vicki Bruce, Patrick Green. Lawrence Erlbaum, London (1985), xiii, +369. Price £8.95 (paperback) , 1986 .