Recognizing Expression Variant Faces from a Single Sample Image per Class

Although important contributions on face recognition have been recently reported, few are focused on how to robustly recognize expression variant faces from as little as one single training sample per class. Since learning cannot generally be applied when only one sample per class is available, matching techniques (distance measures) are usually employed instead (e.g. correlations). However, distance measures generally attempt to match all features with equal importance (weighting), because not only it is difficult to know which features are more useful (for classification), but when or under which circumstances this happens. For example, when recognizing faces in the original image space (e.g. using the Euclidean distance–correlation), it is not known which pixels are more and which are less appropriate to be used. In this contribution, we use the optical flow between the testing and sample images as a measure of how good each pixel is. Pixels that have a small flow will have high weights, pixels with a large flow will have small weights. Our experimental results show that the method proposed in this contribution outperforms the classical Euclidean distance (correlation) measure and the PCA approach.

[1]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[3]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[4]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[6]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Aleix M. Martinez Matching expression variant faces , 2003, Vision Research.

[9]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[10]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[11]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[12]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[13]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..