Using the Surrounding WEB Content of Pictures to Generate Candidates for Photo Annotation

The nowadays pervasive mobile devices embed among one or two cameras a multitude of sensors facilitating the capture of the surrounding context and thus the picture visual content is enriched with the additional metadata. Moreover, the digital storage of the pictures either on a personal device or by the use of an online photo management and sharing platform enables a series of services among which the generation of a list of individuals likely to appear in a certain picture. We propose a novel approach for annotating individuals appearing in pictures to benefit from this information gained on the one side from the sensors embedded in the devices used to capture the picture and on the other hand from the online platform hosting the pictures. Precisely, the gathered information is used for the creation of a list of candidates likely to appear in the picture that a user wants to annotate dispensing him to browse a large list of users to choose from. We make a thoroughly discussion on the opportunities brought by a collection of annotated pictures and discuss on the further expediencies that it may bring in the healthcare domain in an attempt to extend the current researchers' vision who consider that the only advantages of having an annotated collection of pictures are a better retrieval and an improved management.

[1]  Yuxiao Hu,et al.  Efficient propagation for face annotation in family albums , 2004, MULTIMEDIA '04.

[2]  Tsuhan Chen,et al.  Using Group Prior to Identify People in Consumer Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Tsuhan Chen,et al.  Using Context to Recognize People in Consumer Images , 2009, IPSJ Trans. Comput. Vis. Appl..

[4]  Anita Shinde,et al.  A Study on Image Annotation Techniques , 2012 .

[5]  Nenghai Yu,et al.  Distance metric learning from uncertain side information with application to automated photo tagging , 2009, ACM Multimedia.

[6]  Christophe Prieur,et al.  Thematic vs. social networks in web 2.0 communities: A case study on Flickr groups , 2007 .

[7]  Mor Naaman,et al.  Leveraging context to resolve identity in photo albums , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[8]  Mingjing Li,et al.  Automated annotation of human faces in family albums , 2003, MULTIMEDIA '03.

[9]  Chien-Li Chou,et al.  Social Photo Tagging Recommendation Using Community-Based Group Associations , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[10]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[11]  Wesley De Neve,et al.  Collaborative Face Recognition for Improved Face Annotation in Personal Photo Collections Shared on Online Social Networks , 2011, IEEE Transactions on Multimedia.

[12]  Trevor Darrell,et al.  Autotagging Facebook: Social network context improves photo annotation , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[14]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[15]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Simon King,et al.  Towards context-aware face recognition , 2005, MULTIMEDIA '05.

[17]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Alan F. Smeaton,et al.  Context-Aware Person Identification in Personal Photo Collections , 2009, IEEE Transactions on Multimedia.

[19]  Marco A. Casanova,et al.  PhotoGeo: a photo digital library with spatial-temporal support and self-annotation , 2011, Multimedia Tools and Applications.

[20]  John Adcock,et al.  Leveraging face recognition technology to find and organize photos , 2004, MIR '04.