Face Album: Towards automatic photo management based on person identity on mobile phones

We implement a new photo management system ‘Face Album’ on mobile phones, which organizes photos by person identity, as is shown in Fig. 1. We automatically group faces into clusters to release user workload. Our system is composed of two pools: a certain pool with reliable clusters consisting of faces from same identity, and an uncertain pool containing faces that are lacking in evidence to be recognized. Constantly as new faces increase, the certain pool and uncertain pool work together to either assign new faces to existing clusters or discover new identities in the album. In addition, user interaction is introduced for some deviation corrections. Experiments indicate that our results are close to offline hierarchical clustering method while a subjective survey shows our photo management system is favored by users.

[1]  Xiaogang Wang,et al.  Deep Convolutional Network Cascade for Facial Point Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  LONGBIN CHEN,et al.  Face Annotation for Family Photo Album Management , 2003, Int. J. Image Graph..

[3]  Anil K. Jain,et al.  Unconstrained Face Recognition: Identifying a Person of Interest From a Media Collection , 2014, IEEE Transactions on Information Forensics and Security.

[4]  Zhenan Sun,et al.  A Lightened CNN for Deep Face Representation , 2015, ArXiv.

[5]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[6]  Yuandong Tian,et al.  A Face Annotation Framework with Partial Clustering and Interactive Labeling , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Honglak Lee,et al.  Learning to Align from Scratch , 2012, NIPS.

[9]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Yuandong Tian,et al.  EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking , 2007, CHI.

[12]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.

[13]  Ning Zhang,et al.  Beyond frontal faces: Improving Person Recognition using multiple cues , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[15]  Yan-Ying Chen,et al.  Automatic Facial Image Annotation and Retrieval by Integrating Voice Label and Visual Appearance , 2014, ACM Multimedia.

[16]  Kraig Finstad,et al.  The Usability Metric for User Experience , 2010, Interact. Comput..

[17]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[18]  Jian Sun,et al.  A rank-order distance based clustering algorithm for face tagging , 2011, CVPR 2011.