Joint People Recognition across Photo Collections Using Sparse Markov Random Fields

We show how to jointly recognize people across an entire photo collection while considering the specifies of personal photos that often depict multiple people. We devise and explore a sparse but efficient graph design based on a second-order Markov Random Field, and that utilizes a distance-based face description method. Experiments on two datasets demonstrate and validate the effectiveness of our probabilistic approach compared to traditional methods.

[1]  Ebroul Izquierdo,et al.  Gender-aided people recognition in photo collections , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[2]  Gang Hua,et al.  Joint People, Event, and Location Recognition in Personal Photo Collections Using Cross-Domain Context , 2010, ECCV.

[3]  Gang Wang,et al.  Seeing People in Social Context: Recognizing People and Social Relationships , 2010, ECCV.

[4]  Gang Hua,et al.  How to make Face Recognition Work: The Power of Modeling Context , 2012 .

[5]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ebroul Izquierdo,et al.  Recognizing people by face and body in Photo Collections , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[7]  Ying He,et al.  Retrieval-Based Face Annotation by Weak Label Regularized Local Coordinate Coding , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Dragomir Anguelov,et al.  Contextual Identity Recognition in Personal Photo Albums , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[10]  Ebroul Izquierdo,et al.  People recognition in ambiguously labeled Photo Collections , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[11]  Alan F. Smeaton,et al.  Context-Aware Person Identification in Personal Photo Collections , 2009, IEEE Transactions on Multimedia.

[12]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[14]  Tsuhan Chen,et al.  Using a Markov Network to Recognize People in Consumer Images , 2007, 2007 IEEE International Conference on Image Processing.

[15]  Ebroul Izquierdo,et al.  Graph-based recognition in photo collections using social semantics , 2011, SBNMA '11.

[16]  Tsuhan Chen,et al.  Using Context to Recognize People in Consumer Images , 2009, IPSJ Trans. Comput. Vis. Appl..