Separating Directional Lighting Variability in Statistical Face Modelling Based on Texture Space Decomposition

In this paper we propose a simple method for decomposing the linear texture space of a facial appearance model into two linear subspaces, one for inter-individual variability and another for variations caused by directional changes of the lighting conditions. The approach used is to create one linear subspace from individuals with uniform illumination conditions and then filter a set of images with various directional lighting conditions by projecting corresponding textures on the previously built space; the residues are further used to build a second subspace for directional lighting. The resulted subspaces are orthogonal, so the overall texture model can be obtained by a simple concatenation of the two subspaces. The main advantage of this representation is that two sets of parameters are used to control inter-individual variation and separately intra-individual variation due to changes in illumination conditions.

[1]  Takeshi Shakunaga,et al.  Robust face recognition by combining projection-based image correction and decomposed eigenface , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  Gary Bradski,et al.  Learning-Based Computer Vision with Intels Open Source Computer Vision Library , 2005 .

[3]  P. Corcoran,et al.  In-camera person-indexing of digital images , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[4]  Stan Z. Li,et al.  Direct appearance models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Narendra Ahuja,et al.  Panoramic image acquisition , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Martin Bichsel,et al.  Illumination invariant object recognition , 1995, Proceedings., International Conference on Image Processing.

[7]  David J. Kriegman,et al.  Clustering appearances of objects under varying illumination conditions , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  D. Shock,et al.  Comparison of rural remote site production of digital images employing a film digitizer or a computed radiography (CR) system , 1995, Proceedings of the Fourth International Conference on Image Management and Communication (IMAC 95).

[9]  Vasile Buzuloiu,et al.  Image processing techniques to detect and filter objectionable images based on skin tone and shape recognition , 2001, ICCE. International Conference on Consumer Electronics (IEEE Cat. No.01CH37182).

[10]  Ahmed H. Tewfik,et al.  Visual masking and the design of magnetic resonance image acquisition , 1995, Proceedings., International Conference on Image Processing.

[11]  Sanghoon Sull,et al.  Coarse-to-Fine Classification for Image-Based Face Detection , 2006, CIVR.

[12]  André Oosterlinck,et al.  Range Image Acquisition with a Single Binary-Encoded Light Pattern , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[14]  Aziz Umit Batur,et al.  Adaptive active appearance models , 2005, IEEE Transactions on Image Processing.

[15]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Jan J. Gerbrands,et al.  On the relationships between SVD, KLT and PCA , 1981, Pattern Recognit..

[17]  Takeshi Shakunaga,et al.  Decomposed eigenface for face recognition under various lighting conditions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[19]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Aziz Umit Batur,et al.  Linear subspaces for illumination robust face recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  David J. Beymer,et al.  Pose-invariant face recognition using real and virtual views , 1996 .

[22]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[24]  Fabrizio Smeraldi,et al.  Facial feature detection by saccadic exploration of the Gabor decomposition , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[25]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[26]  Robert Ulichney,et al.  Automatic red-eye detection and correction , 2002, Proceedings. International Conference on Image Processing.

[27]  Nicholas Costen,et al.  Automatic extraction of the face identity-subspace , 2002, Image Vis. Comput..

[28]  John K. Tsotsos,et al.  Adaptive Step Size Window Matching for Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[29]  Peter Schelkens,et al.  Embedded multiple description scalar quantizers for progressive image transmission , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[30]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[31]  Jing Xiao,et al.  Fitting a Single Active Appearance Model Simultaneously to Multiple Images , 2004, BMVC.

[32]  Yongbeom Lee,et al.  Lenticular stereoscopic imaging and displaying techniques with no special glasses , 1995, Proceedings., International Conference on Image Processing.

[33]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[34]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[35]  Enrique Muñoz,et al.  Efficiently Estimating Facial Expression and Illumination in Appearance-based Tracking , 2006, BMVC.

[36]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[37]  Timothy F. Cootes,et al.  On representing edge structure for model matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[38]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[39]  Luc Van Gool,et al.  Parametric Stereo for Multi-pose Face Recognition and 3D-Face Modeling , 2005, AMFG.

[40]  A. Z. Kouzani.  Illumination-effects compensation in facial images , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[41]  Raphaël Féraud,et al.  A Fast and Accurate Face Detector Based on Neural Networks , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Rogério Schmidt Feris,et al.  Active Wavelet Networks for Face Alignment , 2003, BMVC.

[43]  David J. Kriegman,et al.  From few to many: generative models for recognition under variable pose and illumination , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[44]  Ramesh Raskar,et al.  Why I Want a Gradient Camera , 2022 .

[45]  Michal Kozubek,et al.  Automated multi-view 3D image acquisition in human genome research , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[46]  Jing Xiao,et al.  Multi-view AAM fitting and camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[47]  Takeo Kanade,et al.  A multibaseline stereo system with active illumination and real-time image acquisition , 1995, Proceedings of IEEE International Conference on Computer Vision.

[48]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[49]  Danijel Skocaj,et al.  Range image acquisition of objects with non-uniform albedo using structured light range sensor , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[50]  Shizuo Sakamoto,et al.  Geodesic illumination basis: compensating for illumination variations in any pose for face recognition , 2002, Object recognition supported by user interaction for service robots.

[51]  S. Mitra,et al.  Gaussian mixture models based on the frequency spectra for human identification and illumination classification , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[52]  B. Sankur,et al.  Face detection using boosted tree classifier stages , 2004, Proceedings of the IEEE 12th Signal Processing and Communications Applications Conference, 2004..

[53]  C. Goodall.  Procrustes methods in the statistical analysis of shape , 1991 .

[54]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[55]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Nicholas Costen,et al.  Simultaneous extraction of functional face subspaces , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[57]  Rasmus Larsen,et al.  Multi-band modelling of appearance , 2003, Image Vis. Comput..

[58]  Mark Shand.  Flexible image acquisition using reconfigurable hardware , 1995, Proceedings IEEE Symposium on FPGAs for Custom Computing Machines.

[59]  Svetha Venkatesh,et al.  Application of the DCT energy histogram for face recognition , 2004 .

[60]  Stan Z. Li,et al.  Nonlinear mapping from multi-view face patterns to a Gaussian distribution in a low dimensional space , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[61]  Christine Podilchuk,et al.  Face recognition using DCT-based feature vectors , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[62]  Alfred C. Weaver,et al.  Design and implementation of a digital teleultrasound system for real-time remote diagnosis , 1995, Proceedings Eighth IEEE Symposium on Computer-Based Medical Systems.

[63]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[64]  David J. Kriegman,et al.  Illumination cones for recognition under variable lighting: faces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[65]  P. Prusinkiewicz,et al.  Variance‐based color image quantization for frame buffer display , 1990 .

[66]  Luhong Liang,et al.  A detector tree of boosted classifiers for real-time object detection and tracking , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[67]  W. Huang,et al.  Eye tracking with statistical learning and sequential Monte Carlo sampling , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[68]  Nobuyuki Kita,et al.  Archiving technology for plant inspection images captured by mobile active cameras "4D visible memory" , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[69]  Niels da Vitoria Lobo,et al.  Face detection using templates , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[70]  Andreas Ernst,et al.  Face detection with the modified census transform , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[71]  P. Corcoran,et al.  Automatic indexing of consumer image collections using person recognition techniques , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[72]  Timothy F. Cootes,et al.  A Comparative Evaluation of Active Appearance Model Algorithms , 1998, BMVC.

[73]  Sami Romdhani,et al.  Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions , 2002, ECCV.

[74]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[75]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..

[76]  Marc Rioux,et al.  Object model creation from multiple range images: acquisition, calibration, model building and verification , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[77]  Timothy F. Cootes,et al.  Advances in active appearance models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[78]  Wen Gao,et al.  Virtual face image generation for illumination and pose insensitive face recognition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[79]  Horst Bischof,et al.  Fast Active Appearance Model Search Using Canonical Correlation Analysis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Jiliu Zhou,et al.  Real-time human face detection in color image , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[81]  Lei Zhang,et al.  A CBIR method based on color-spatial feature , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[82]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Takeo Kanade,et al.  Real-time combined 2D+3D active appearance models , 2004, CVPR 2004.