Gabor Wavelet Networks for Object Representation

In this article we want to introduce first the Gabor wavelet network as a model based approach for an effective and efficient object representation. The Gabor wavelet network has several advantages such as invariance to some degree with respect to translation, rotation and dilation. Furthermore, the use of Gabor filters ensured that geometrical and textural object features are encoded. The feasibility of the Gabor filters as a model for local object features ensures a considerable data reduction while at the same time allowing any desired precision of the object representation ranging from a sparse to a photo-realistic representation. In the second part of the paper we will present an approach for the estimation of a head pose that is based on the Gabor wavelet networks.

[1]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[2]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[4]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[5]  A. Calderón,et al.  Intermediate spaces and interpolation , 1963 .

[6]  A. Yuille.  Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[7]  Shaogang Gong,et al.  Face Tracking and Pose Representation , 1996, BMVC.

[8]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[10]  Hiroshi Murase,et al.  Dimensionality of illumination in appearance matching , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[11]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[12]  Ruzena Bajcsy,et al.  Active and exploratory perception , 1992, CVGIP Image Underst..

[13]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[14]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[16]  R. Lathe.  Phd by thesis , 1988, Nature.

[17]  Hong Yan,et al.  Locating and extracting the eye in human face images , 1996, Pattern Recognit..

[18]  Gerald Sommer.  Verhaltensbasierter Entwurf technischer visueller Systeme , 1995, Künstliche Intell..

[19]  Thomas Vetter,et al.  Estimating Coloured 3D Face Models from Single Images: An Example Based Approach , 1998, ECCV.

[20]  Yehezkel Yeshurun,et al.  Preprocessing of Face Images: Detection of Features and Pose Normalization , 1998, Comput. Vis. Image Underst..

[21]  Osamu Nakamura,et al.  Identification of human faces based on isodensity maps , 1991, Pattern Recognit..

[22]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998 .

[24]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  John Mark,et al.  Introduction to radial basis function networks , 1996 .

[26]  Alex Waibel,et al.  Gaze Tracking Based on Face‐Color , 1995 .

[27]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Gerald Sommer,et al.  Gabor Wavelet Networks for Object Representation , 2000, Theoretical Foundations of Computer Vision.

[29]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[30]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[31]  Harold H. Szu,et al.  Neural network adaptive wavelets for signal representation and classification , 1992 .

[32]  Cornelius T. Leondes,et al.  Advances in control systems : theory and applications , 1966 .

[33]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[34]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[35]  Rainer Herpers,et al.  Teleconferencing Using an Attentive Camera System , 1999 .

[36]  Rainer Herpers,et al.  An Attentive Processing Strategy for the Analysis of Facial Features , 1998 .

[37]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Ramesh Jain.  Expansive vision , 1994 .

[39]  Alex Pentland,et al.  Probabilistic visual learning for object detection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[40]  Rolf-Rainer Grigat,et al.  Ein echtzeitfähiges System zur Erkennung der Blickrichtung des menschlichen Auges , 1997, DAGM-Symposium.

[41]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[42]  David J. Kriegman,et al.  The yale face database , 1997 .

[43]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[44]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[45]  LeeTai Sing.  Image Representation Using 2D Gabor Wavelets , 1996 .

[46]  Alexandros Eleftheriadis,et al.  Automatic Location Tracking of Faces and Facial Features in Video Sequences , 1995 .

[47]  Hagit Hel-Or,et al.  Attentive transmission , 1990, J. Vis. Commun. Image Represent..

[48]  Kunihiro Chihara,et al.  A robust algorithm for 3D head pose estimation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[49]  Hyeonjoon Moon,et al.  The FERET verification testing protocol for face recognition algorithms , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[50]  Markus Michaelis,et al.  Low level image processing using steerable filters , 1995 .

[51]  Gregory D. Hager,et al.  Robust vision-based object tracking , 1998 .

[52]  Andrew Zisserman,et al.  Shape from symmetry: detecting and exploiting symmetry in affine images , 1995, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[53]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Leonardo Maria Reyneri.  Unification of neural and wavelet networks and fuzzy systems , 1999, IEEE Trans. Neural Networks.

[55]  A. Calderón.  Intermediate spaces and interpolation, the complex method , 1964 .

[56]  Hideki Hayakawa.  Photometric stereo under a light source with arbitrary motion , 1994 .

[57]  Jiri Matas,et al.  Fast face localisation and verification , 1999, Image Vis. Comput..

[58]  Ingemar J. Cox,et al.  Feature-based face recognition using mixture-distance , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[59]  Ian Craw,et al.  Tracking and Measuring Drivers Eyes , 1995, BMVC.

[60]  Christoph von der Malsburg,et al.  Single-View Based Recognition of Faces Rotated in Depth , 1995 .

[61]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[62]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[63]  Takeo Kanade,et al.  Rotation invariant neural network-based face detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[64]  J Ang.  ALGEBRAIC FEATURE EXTRACTION OF IMAGES FOR RECOGNITION , 1992 .

[65]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Gerald Sommer,et al.  Intrinsic Dimensionality Estimation With Optimally Topology Preserving Maps , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[67]  Shigeo Morishima,et al.  Facial image reconstruction by estimated muscle parameter , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[68]  Gerald Sommer,et al.  Affine real-time face tracking using Gabor wavelet networks , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[69]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[70]  Brian V. Funt,et al.  Is Machine Colour Constancy Good Enough? , 1998, ECCV.

[71]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Gregory D. Hager,et al.  Incremental focus of attention for robust visual tracking , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[73]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[74]  Gerald Sommer,et al.  Efficient Head Pose Estimation with Gabor Wavelet Networks , 2000, BMVC.

[75]  Gerald Sommer,et al.  Algebraic Frames for the Perception-Action Cycle , 2000, Lecture Notes in Computer Science.

[76]  Oskar Dressler,et al.  Künstliche Intelligenz? , 1986, FIFF Jahrestagung.

[77]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[78]  Gösta H. Granlund,et al.  From Multidimensional Signals to the Generation of Responses , 1997, AFPAC.

[79]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[80]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[81]  Shimon Edelman,et al.  Learning to Recognize Faces from Examples , 1992, ECCV.

[82]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[83]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[84]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[85]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[86]  Roberto Cipolla,et al.  Determining the gaze of faces in images , 1994, Image Vis. Comput..

[87]  Y. Meyer.  Wavelets and Operators , 1993 .

[88]  J. Davenport.  Editor , 1960 .

[89]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[90]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[91]  Richard Kronland-Martinet,et al.  Analysis of Sound Patterns through Wavelet transforms , 1987, Int. J. Pattern Recognit. Artif. Intell..

[92]  Qian Chen,et al.  3D head pose estimation without feature tracking , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[93]  Gerald Sommer,et al.  Dynamic Cell Structure Learns Perfectly Topology Preserving Map , 1995, Neural Computation.

[94]  A. Shashua.  Geometry and Photometry in 3D Visual Recognition , 1992 .

[95]  John Daugman,et al.  Face and Gesture Recognition: Overview , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[96]  Helge J. Ritter,et al.  Image Based Recognition of Graze Direction Using Adaptive Methods , 1997, Gesture Workshop.

[97]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..

[98]  Ming Xu,et al.  Detecting head pose from stereo image sequence for active face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[99]  John K. Tsotsos.  Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[100]  G. Sommer,et al.  Affine real-time face tracking using a wavelet network , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[101]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[102]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[103]  Hanqi Zhuang,et al.  On improving eye feature extraction using deformable templates , 1994, Pattern Recognit..

[104]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[105]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[106]  K. Roberts,et al.  Thesis , 2002 .

[107]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[108]  Gerald Sommer,et al.  Algebraic Aspects of Designing Behaviour Based Systems , 1997, AFPAC.

[109]  Norbert Krüger,et al.  Determination of face position and pose with a learned representation based on labelled graphs , 1997, Image Vis. Comput..

[110]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[111]  Rama Chellappa,et al.  A unified approach to boundary perception: edges, textures, and illusory contours , 1993, IEEE Trans. Neural Networks.

[112]  William H. Press,et al.  Numerical recipes , 1990 .

[113]  Nicholas Costen,et al.  Automatic Face Recognition: What Representation? , 1996, ECCV.

[114]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[115]  Roberto Cipolla,et al.  Feature-based human face detection , 1997, Image Vis. Comput..

[116]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[117]  T. Michael Knasel,et al.  Robotics and autonomous systems , 1988, Robotics Auton. Syst..

[118]  G. C. Stockman,et al.  Computer operation via face orientation , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[119]  E. Marg.  A VISION OF THE BRAIN , 1994 .

[120]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[121]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[122]  Trevor Darrell,et al.  Active face tracking and pose estimation in an interactive room , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.