Aiding face recognition with social context association rule based re-ranking

Humans are very efficient at recognizing familiar face images even in challenging conditions. One reason for such capabilities is the ability to understand social context between individuals. Sometimes the identity of the person in a photo can be inferred based on the identity of other persons in the same photo, when some social context between them is known. This research presents an algorithm to utilize co-occurrence of individuals as the social context to improve face recognition. Association rule mining is utilized to infer multi-level social context among subjects from a large repository of social transactions. The results are demonstrated on the G-album and on the SN-collection pertaining to 4675 identities prepared by the authors from a social networking Web site. The results show that association rules extracted from social context can be used to augment face recognition and improve the identification performance.

[1]  Gang Wang,et al.  Seeing People in Social Context: Recognizing People and Social Relationships , 2010, ECCV.

[2]  Gang Hua,et al.  Which faces to tag: Adding prior constraints into active learning , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Bernard Malissen,et al.  Two faces are better than one , 1996, Nature.

[4]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Ramesh Jain,et al.  Context Networks for Annotating Personal Media , 2013 .

[6]  Liyan Zhang,et al.  A unified framework for context assisted face clustering , 2013, ICMR '13.

[7]  O'HareNeil,et al.  Context-aware person identification in personal photo collections , 2009 .

[8]  Luc Van Gool,et al.  Augmented faces , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Jason Hochreiter,et al.  Exploring album structure for face recognition in online social networks , 2014, Image Vis. Comput..

[10]  Ming-Syan Chen,et al.  Association and Temporal Rule Mining for Post-Filtering of Semantic Concept Detection in Video , 2008, IEEE Transactions on Multimedia.

[11]  Tsuhan Chen,et al.  Using Group Prior to Identify People in Consumer Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Hong-Yuan Mark Liao,et al.  Discovering informative social subgraphs and predicting pairwise relationships from group photos , 2012, ACM Multimedia.

[14]  Kurt Hornik,et al.  The arules R-Package Ecosystem: Analyzing Interesting Patterns from Large Transaction Data Sets , 2011, J. Mach. Learn. Res..

[15]  David J. Kriegman,et al.  Two faces are better than one: Face recognition in group photographs , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[16]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[17]  Samarth Bharadwaj,et al.  Biometric quality: a review of fingerprint, iris, and face , 2014, EURASIP Journal on Image and Video Processing.

[18]  Gang Hua,et al.  Joint People, Event, and Location Recognition in Personal Photo Collections Using Cross-Domain Context , 2010, ECCV.

[19]  Enrique G. Ortiz,et al.  Evaluation of face recognition techniques for application to facebook , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[20]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  Trevor Darrell,et al.  Toward Large-Scale Face Recognition Using Social Network Context , 2010, Proceedings of the IEEE.

[22]  Trevor Darrell,et al.  Autotagging Facebook: Social network context improves photo annotation , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[23]  Simon King,et al.  Towards context-aware face recognition , 2005, MULTIMEDIA '05.

[24]  Yuandong Tian,et al.  EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking , 2007, CHI.

[25]  Rama Chellappa,et al.  Propagation of facial identities in a social network , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[26]  Patrick J. Flynn,et al.  Active Clustering with Ensembles for Social structure extraction , 2014, IEEE Winter Conference on Applications of Computer Vision.

[27]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[29]  Terrance E. Boult,et al.  Fusing with context: A Bayesian approach to combining descriptive attributes , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[30]  Alan F. Smeaton,et al.  Context-Aware Person Identification in Personal Photo Collections , 2009, IEEE Transactions on Multimedia.