Clustering techniques for personal photo album management

We propose a novel approach for the automatic representation of pictures achieving a more effective organization of personal photo albums. Images are analyzed and described in multiple representation spaces, namely, faces, background, and time of capture. Faces are automatically detected, rectified, and represented, projecting the face itself in a common low-dimensional eigenspace. Backgrounds are represented with low-level visual features based on an RGB histogram and Gabor filter bank. Faces, time, and background information of each image in the collection is automatically organized using a mean-shift clustering technique. Given the particular domain of personal photo libraries, where most of the pictures contain faces of a relatively small number of different individuals, clusters tend to be semantically significant besides containing visually similar data. We report experimental results based on a data set of about 1000 images where automatic detection and rectification of faces lead to approximately 400 faces. Significance of clustering has been evaluated, and results are very encouraging.

[1]  Edoardo Ardizzone,et al.  A novel approach to personal photo album representation and management , 2008, Electronic Imaging.

[2]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  John Adcock,et al.  Leveraging face recognition technology to find and organize photos , 2004, MIR '04.

[4]  Edward Y. Chang,et al.  A scalable service for photo annotation, sharing, and search , 2006, MM '06.

[5]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[6]  Dingxing Wang,et al.  Boosting image classification with LDA-based feature combination for digital photograph management , 2005, Pattern Recognit..

[7]  Edoardo Ardizzone,et al.  Automatic Image Representation for Content-Based Access to Personal Photo Album , 2007, ISVC.

[8]  Yuandong Tian,et al.  EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking , 2007, CHI.

[9]  Mohamed Abdel-Mottaleb,et al.  Content-based photo album management using faces' arrangement , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[10]  Ben Shneiderman,et al.  Visualization methods for personal photo collections: browsing and searching in the PhotoFinder , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[11]  John C. Dalton,et al.  Hierarchical browsing and search of large image databases , 2000, IEEE Trans. Image Process..

[12]  Miin-Shen Yang,et al.  A cluster validity index for fuzzy clustering , 2005, Pattern Recognit. Lett..

[13]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[14]  Mingjing Li,et al.  Automated annotation of human faces in family albums , 2003, MULTIMEDIA '03.

[15]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Yee Whye Teh,et al.  Names and faces in the news , 2004, CVPR 2004.

[17]  Mor Naaman,et al.  Leveraging context to resolve identity in photo albums , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[18]  A. Loui,et al.  Event clustering of consumer pictures using foreground/background segmentation , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[19]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[21]  Shiri Gordon,et al.  Unsupervised image-set clustering using an information theoretic framework , 2006, IEEE Transactions on Image Processing.

[22]  Yuxiao Hu,et al.  Efficient propagation for face annotation in family albums , 2004, MULTIMEDIA '04.

[23]  Mohamed Abdel-Mottaleb,et al.  Hierarchical clustering algorithm for fast image retrieval , 1998, Electronic Imaging.

[24]  Yang Song,et al.  Context-Aided Human Recognition - Clustering , 2006, ECCV.

[25]  Andreas E. Savakis,et al.  Automatic image event segmentation and quality screening for albuming applications , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[26]  Min Chen,et al.  A unified framework for image database clustering and content-based retrieval , 2004, MMDB '04.

[27]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Chun-Rong Huang,et al.  Image Content Clustering and Summarization for Photo Collections , 2006, 2006 IEEE International Conference on Multimedia and Expo.