Automatic Detection and Clustering of Actor Faces based on Spectral Clustering Techniques

We describe a video indexing system that aims at indexing large video files in relation to the presence of similar faces. The detection of near-frontal view faces is done with a cascade of weak classifier. Face tracking is done through a particle filter and generate trajectories. Face clusters are found based on a spectral clustering approach. We compare the performance of various spectral clustering techniques based on 2DPCA features. The system performance is evaluated against a public face database as well as on a real full-length feature movie.

[1]  Jianbo Shi,et al.  Learning Segmentation by Random Walks , 2000, NIPS.

[2]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[3]  Jan Poland,et al.  Amplifying the Block Matrix Structure for Spectral Clustering. , 2005 .

[4]  Andrew Zisserman,et al.  Automatic face recognition for film character retrieval in feature-length films , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Sharath Pankanti,et al.  Initialization-independent spectral clustering with applications to automatic video analysis , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Andrew Zisserman,et al.  Automated visual identification of characters in situation comedies , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[7]  Takeo Kanade,et al.  Name-It: Naming and Detecting Faces in News Videos , 1999, IEEE Multim..

[8]  Langis Gagnon,et al.  Toward an Application of Content-Based Video Indexing to Computer- Assisted Descriptive Video , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[9]  Kuan-Quan Wang,et al.  Assembled matrix distance metric for 2DPCA-based face and palmprint recognition , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[10]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[11]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[13]  Andrew Zisserman,et al.  Person Spotting: Video Shot Retrieval for Face Sets , 2005, CIVR.

[14]  Andrew W. Fitzgibbon,et al.  On Affine Invariant Clustering and Automatic Cast Listing in Movies , 2002, ECCV.

[15]  Daoqiang Zhang,et al.  Diagonal principal component analysis for face recognition , 2006, Pattern Recognit..

[16]  Mubarak Shah,et al.  Detection and representation of scenes in videos , 2005, IEEE Transactions on Multimedia.

[17]  Gerhard Rigoll,et al.  Content based indexing of images and video using face detection and recognition methods , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[18]  E. K. Teoh,et al.  Generalized 2D principal component analysis , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[19]  Jitendra Malik,et al.  Spectral grouping using the Nystrom method , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Cordelia Schmid,et al.  Face Detection and Tracking in a Video by Propagating Detection Probabilities , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Jean-Marc Odobez,et al.  Spectral Structuring of Home Videos , 2003, CIVR.

[23]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[24]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Jianbo Shi,et al.  Multiclass spectral clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Marina Meila,et al.  A Comparison of Spectral Clustering Algorithms , 2003 .

[27]  Fourth Canadian Conference on Computer and Robot Vision (CRV 2007), 28-30 May 2007, Montreal, Quebec, Canada , 2007, CRV.