Unsupervised recognition of multi-view face sequences based on pairwise clustering with attraction and repulsion

In this paper we propose and investigate the possibilities inherent in a new, unsupervised approach to multi-view face recognition, which can be formulated mathematically as a problem of partitioning of proximity data, obtained from multi-view face image sequences. The proposed approach is implemented in two novel pairwise clustering algorithms, CAR1 and CAR2, which partition the input data into identity clusters by performing combinatorial optimization guided by two types of interaction forces, attraction and repulsion, imposed on the original proximity matrices. Several experiments were conducted in order to test the performance of the proposed algorithms on real-world datasets including both frontal and side-view faces, which have been gathered over a period of several months. The obtained results can be considered encouraging for the general approach proposed here, and the new algorithms compared favorably to two other pairwise clustering algorithms, recently proposed in the image segmentation literature.

[1]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  David R. Karger,et al.  A new approach to the minimum cut problem , 1996, JACM.

[3]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[4]  Kim L. Boyer,et al.  Quantitative measures of change based on feature organization: eigenvalues and eigenvectors , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Shaohua Kevin Zhou,et al.  Exemplar-based face recognition from video , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[9]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  William Rucklidge,et al.  Efficiently Locating Objects Using the Hausdorff Distance , 1997, International Journal of Computer Vision.

[11]  Geoffrey C. Fox,et al.  Constrained Clustering as an Optimization Method , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[13]  Hiroshi Murase,et al.  VQ-faces - unsupervised face recognition from image sequences , 2002, Proceedings. International Conference on Image Processing.

[14]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[16]  Michael Werman,et al.  Self-Organization in Vision: Stochastic Clustering for Image Segmentation, Perceptual Grouping, and Image Database Organization , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  David G. Stork,et al.  Pattern Classification , 1973 .

[18]  Juyang Weng,et al.  Toward automation of learning: the state self-organization problem for a face recognizer , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[19]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[20]  Hiroshi Murase,et al.  Unsupervised face recognition by associative chaining , 2003, Pattern Recognit..

[21]  Boris Mirkin,et al.  Mathematical Classification and Clustering , 1996 .

[22]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[23]  Shaogang Gong,et al.  Face Recognition in Dynamic Scenes , 1997, BMVC.

[24]  Eytan Domany,et al.  Data Clustering Using a Model Granular Magnet , 1997, Neural Computation.

[25]  A. Yuille.  Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[26]  Rose,et al.  Statistical mechanics and phase transitions in clustering. , 1990, Physical review letters.

[27]  Santosh S. Vempala,et al.  On clusterings-good, bad and spectral , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[28]  M. A. Grudin,et al.  On internal representations in face recognition systems , 2000, Pattern Recognit..

[29]  Pietro Perona,et al.  A Factorization Approach to Grouping , 1998, ECCV.

[30]  Rahul Sukthankar,et al.  Memory-based face recognition for visitor identification , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[31]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[32]  Alex Pentland,et al.  Face recognition using view-based and modular eigenspaces , 1994, Optics & Photonics.

[33]  T. Kanade,et al.  A multi-body factorization method for motion analysis , 1995, ICCV 1995.

[34]  Satoshi Suzuki,et al.  Unsupervised visual learning of three-dimensional objects using a modular network architecture , 1999, Neural Networks.

[35]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[36]  Richard J. Mammone,et al.  Automatic systems for the identification and inspection of humans : 28-29 July 1994, San Diego, California , 1994 .

[37]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[38]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[39]  W. Eric L. Grimson,et al.  Similarity templates for detection and recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[40]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[41]  Joachim M. Buhmann,et al.  Pairwise Data Clustering by Deterministic Annealing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  P. Sopp.  Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[43]  Timothy F. Cootes,et al.  Learning to identify and track faces in image sequences , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[44]  Geoffrey E. Hinton,et al.  Evaluation of Adaptive Mixtures of Competing Experts , 1990, NIPS.

[45]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[46]  Shin'ichi Satoh,et al.  Comparative evaluation of face sequence matching for content-based video access , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).