Performance enhancement of 2D face recognition via mosaicing

We describe a face mosaicing scheme that generates a composite face image during enrollment based on the evidence provided by frontal and semi-profile face images of an individual. Face mosaicing obviates the need to store multiple face templates representing multiple poses of a user's face image. In the proposed scheme, the side profile images are aligned with the frontal image using a terrain transform that exploits neighborhood properties to determine the transformation relating the 2 images. Multiresolution splining is then used to blend the side profiles with the frontal image thereby generating a composite face image of the user. A local binary pattern matching algorithm is used to compare an input face image with the template face mosaic. Experiments conducted on a small dataset of 27 users indicate that face mosaicing as described in this paper offers significant benefits by accounting for the pose variations commonly observed in face images.

[1]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Junaed Sattar.  Snakes , Shapes and Gradient Vector Flow , 2022 .

[3]  Arun Ross,et al.  Biometric template selection and update: a case study in fingerprints , 2004, Pattern Recognit..

[4]  Patrick J. Flynn,et al.  A Survey Of 3D and Multi-Modal 3D+2D Face Recognition , 2004 .

[5]  Tsuhan Chen,et al.  Pose-robust face recognition using geometry assisted probabilistic modeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Nalini K. Ratha,et al.  Image mosaicing for rolled fingerprint construction , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[7]  Fan Yang,et al.  Fast panoramic face mosaicing and recognition , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[8]  Sami Romdhani,et al.  Face identification across different poses and illuminations with a 3D morphable model , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[9]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[10]  Mayank Vatsa,et al.  Textural feature based face recognition for single training images , 2005 .

[11]  Anil K. Jain,et al.  Combining classifiers for face recognition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[12]  T. Chen,et al.  Geometry-assisted statistical modeling for face mosaicing , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  Arun Ross,et al.  Fingerprint mosaicking , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[15]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.