Foveated Visual Search for Corners

We cast the problem of corner detection as a corner search process. We develop principles of foveated visual search and automated fixation selection to accomplish the corner search, supplying a case study of both foveated search and foveated feature detection. The result is a new algorithm for finding corners, which is also a corner-based algorithm for aiming computed foveated visual fixations. In the algorithm, long saccades move the fovea to previously unexplored areas of the image, while short saccades improve the accuracy of putative corner locations. The system is tested on two natural scenes. As an interesting comparison study, we compare fixations generated by the algorithm with those of subjects viewing the same images, whose eye movements are being recorded by an eye tracker. The comparison of fixation patterns is made using an information-theoretic measure. Results show that the algorithm is a good locater of corners, but does not correlate particularly well with human visual fixations

[1]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[2]  Alan C. Bovik,et al.  FOVEA: a foveated vergent active stereo vision system for dynamic three-dimensional scene recovery , 1998, IEEE Trans. Robotics Autom..

[3]  Rajesh P. N. Rao,et al.  Modeling Saccadic Targeting in Visual Search , 1995, NIPS.

[4]  W S Geisler,et al.  Sampling-theory analysis of spatial vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[7]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[8]  Alex Pentland,et al.  Probabilistic visual learning for object detection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Zhou Wang,et al.  Embedded foveation image coding , 2001, IEEE Trans. Image Process..

[10]  Alan C Bovik,et al.  Contrast statistics for foveated visual systems: fixation selection by minimizing contrast entropy. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  J. Wolfe Moving towards solutions to some enduring controversies in visual search , 2003, Trends in Cognitive Sciences.

[12]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[13]  Rajesh P. N. Rao,et al.  Learning Saccadic Eye Movements Using Multiscale Spatial Filters , 1994, NIPS.

[14]  B. S. Manjunath,et al.  A Condition Number for Point Matching with Application to Registration and Postregistration Error Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Don H. Johnson,et al.  Symmetrizing the Kullback-Leibler Distance , 2001 .

[16]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[17]  J. Wolfe Visual memory: What do you know about what you saw? , 1998, Current Biology.

[18]  Heiner Deubel,et al.  The Subjective Direction of Gaze Shifts Long Before the Saccade , 1999 .

[19]  J. Alison Noble,et al.  Finding Corners , 1988, Alvey Vision Conference.

[20]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Juan Humberto Sossa Azuela,et al.  Model-based recognition of planar objects using geometric invariants , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  Eileen Kowler,et al.  Saccadic localization of random dot targets , 1998, Vision Research.

[23]  Lambert E. Wixson,et al.  Using intermediate objects to improve the efficiency of visual search , 1994, International Journal of Computer Vision.

[24]  Emanuele Trucco,et al.  Making good features track better , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  Todd S. Horowitz,et al.  Visual search has no memory , 1998, Nature.

[26]  D. E. Irwin,et al.  Lexical Processing during Saccadic Eye Movements , 1998, Cognitive Psychology.

[27]  David G. Lowe,et al.  Scene modelling, recognition and tracking with invariant image features , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[28]  James J. Clark,et al.  Modal Control Of An Attentive Vision System , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[29]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[31]  Anuj Srivastava,et al.  10.11 – Statistical Models of Targets and Clutter for Use in Bayesian Object Recognition , 2005 .

[32]  Peter J. Burt,et al.  Smart sensing within a pyramid vision machine , 1988, Proc. IEEE.

[33]  Anup Basu,et al.  Modelling ecologically specialized biological visual systems , 1997, Pattern Recognit..

[34]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[35]  G Sperling,et al.  Comparison of perception in the moving and stationary eye. , 1990, Reviews of oculomotor research.

[36]  Refractor Vision , 2000, The Lancet.

[37]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[38]  H. Collewijn,et al.  The function of visual search and memory in sequential looking tasks , 1995, Vision Research.

[39]  David E. Irwin,et al.  Evidence against visual integration across saccadic eye movements , 1983, Perception & psychophysics.

[40]  J. Wolfe,et al.  The Psychophysical Evidence for a Binding Problem in Human Vision , 1999, Neuron.

[41]  Irene Y. H. Gu,et al.  Corner-based feature extraction for object retrieval , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[42]  Qiang Ji,et al.  Corner detection with covariance propagation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Roland T. Chin,et al.  Scale-Based Detection of Corners of Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[45]  Rajesh P. N. Rao,et al.  Multiscale filter bank approach to camera-movement control in active vision systems , 1994, Other Conferences.

[46]  Ian D. Reid,et al.  Reactions to peripheral image motion using a head/eye platform , 1993, 1993 (4th) International Conference on Computer Vision.

[47]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Han Wang,et al.  Gray Level Corner Detection , 1998, MVA.

[49]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[50]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[51]  Alan C. Bovik,et al.  Point-of-gaze analysis reveals visual search strategies , 2004, IS&T/SPIE Electronic Imaging.

[52]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[53]  Alan C. Bovik,et al.  Fast algorithms for foveated video processing , 2003, IEEE Trans. Circuits Syst. Video Technol..

[54]  Wilson S. Geisler,et al.  Implementation of a foveated image coding system for image bandwidth reduction , 1996, Electronic Imaging.

[55]  Eileen Kowler The role of visual and cognitive processes in the control of eye movement. , 1990, Reviews of oculomotor research.

[56]  M. Donald On the relative entropy , 1986 .

[57]  Dongxiang Zhou,et al.  An efficient and robust corner detection algorithm , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[58]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[59]  Anil K. Jain,et al.  On reliable curvature estimation , 1989, CVPR.

[60]  W. Geisler,et al.  Separation of low-level and high-level factors in complex tasks: visual search. , 1995, Psychological review.

[61]  SuomelaRiku,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998 .

[62]  Eileen Kowler Eye movements and their role in visual and cognitive processes. , 1990, Reviews of oculomotor research.

[63]  Jayanta Basak,et al.  A connectionist model for corner detection in binary and gray images , 2000, IEEE Trans. Neural Networks Learn. Syst..

[64]  J. Wolfe,et al.  Changing your mind: on the contributions of top-down and bottom-up guidance in visual search for feature singletons. , 2003, Journal of experimental psychology. Human perception and performance.

[65]  H. Deubel,et al.  Current oculomotor research : physiological and psychological aspects , 1999 .

[66]  Gordon D. Love,et al.  Proceedings of the SPIE - The International Society for Optical Engineering , 2005 .

[67]  A. Bovik,et al.  Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis. , 2006, Journal of vision.

[68]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[69]  J. Canny Finding Edges and Lines in Images , 1983 .

[70]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[71]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[73]  Ian D. Reid,et al.  Tracking foveated corner clusters using affine structure , 1993, 1993 (4th) International Conference on Computer Vision.

[74]  David E. Irwin Robert D. Gordon Eye Movements, Attention and Trans-saccadic Memory , 1998 .

[75]  W. S. Gribble Slow visual search in a fast-changing world , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[76]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[77]  R. W. Rodieck The First Steps in Seeing , 1998 .

[78]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  John K. Tsotsos On the relative complexity of active vs. passive visual search , 2004, International Journal of Computer Vision.