A Dynamic and Multiresolution Model of Visual Attention and Its Application to Facial Landmark Detection

Abstract We describe a novel dynamic and multiresolution attention scheme for the generation of visual saccades and its application to locate candidate regions for facial feature recognition. The low-level, data-driven attention model suggested herein, employs a nonlinear sampling lattice of oriented Gaussian filters and uses small oscillatory movements to extract local image characteristics (conspicuity). As the sampling grid moves over the image, multiresolution ``evidences'' of local features are accumulated in a short-term visual memory. We propose a simple integration technique that computes the saliency surface iteratively across saccadic movements. Simulation results on face images demonstrate the applicability of our approach.

[1]  P. Schönemann On artificial intelligence , 1985, Behavioral and Brain Sciences.

[2]  Harry Wechsler,et al.  A Saccadic Vision System for Landmark Detection and Face Recognition , 1998 .

[3]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[4]  Harry Wechsler,et al.  Detection of faces and facial landmarks using iconic filter banks , 1997, Pattern Recognit..

[5]  Jan-Olof Eklundh,et al.  Animate Vision in a Rich Environment , 1995, IJCAI.

[6]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[7]  John K. Tsotsos,et al.  An Attentional Prototype for Early Vision , 1992, ECCV.

[8]  Harry Wechsler,et al.  Benchmark Studies on Face Recognition , 1995 .

[9]  G. Sela,et al.  Fast computation of multiscalar symmetry in foveated images , 1995, Proceedings of Conference on Computer Architectures for Machine Perception.

[10]  M. Jagersand Saliency maps and attention selection in scale and spatial coordinates: an information theoretic approach , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[12]  Jeremy M Wolfe,et al.  Modeling the role of parallel processing in visual search , 1990, Cognitive Psychology.

[13]  Stewart W. Wilson On the Retino-Cortical Mapping , 1983, Int. J. Man Mach. Stud..

[14]  Allen Allport,et al.  Visual attention , 1989 .

[15]  Harry Wechsler,et al.  Attention and pattern detection using sensory and reactive control mechanisms , 1996, Proceedings of 13th International Conference on Pattern Recognition.