Care to Share?: Learning to Rank Personal Photos for Public Sharing

With mobile devices, users are taking ever-growing numbers of photos every day. These photos are uploaded to social sites such as Facebook and Flickr, often automatically. Yet, the portion of these uploaded photos being publicly shared is low, and on a constant decline. Deciding which photo to share takes considerable time and attention, and many users would rather forfeit the social interaction and engagement than sift through their piles of uploaded photos. In this paper, we introduce a novel task of recommending socially-engaging photos to their creators for public sharing. This will turn a tedious manual chore into a quick, software-assisted process. We provide extensive analysis over a large-scale dataset from the Flickr photo sharing website, which reveals some of the traits of photo sharing in such sites. Additionally, we present a ranking algorithm for the task that comprises three steps:(a) grouping of near-duplicate photos;(b) ranking the photos in each group by their "shareability"; and(c) ranking the groups by their likelihood to contain a shareable photo. A large-scale experiment allows us to evaluate our algorithm and show its benefits compared to competitive baselines and algorithmic alternatives.

[1]  Marc Davis,et al.  The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing , 2005, CHI Extended Abstracts.

[2]  Andrew D. Miller,et al.  Give and take: a study of consumer photo-sharing culture and practice , 2007, CHI.

[3]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[4]  Wei-Ta Chu,et al.  Automatic selection of representative photo and smart thumbnailing using near-duplicate detection , 2008, ACM Multimedia.

[5]  Ramesh C. Jain,et al.  Summarization of personal photologs using multidimensional content and context , 2011, ICMR '11.

[6]  Radomír Mech,et al.  Event-Specific Image Importance , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Mor Naaman,et al.  Generating summaries and visualization for large collections of geo-referenced photographs , 2006, MIR '06.

[8]  David A. Shamma,et al.  The New Data and New Challenges in Multimedia Research , 2015, ArXiv.

[9]  Koby Crammer,et al.  Adaptive regularization of weight vectors , 2009, Machine Learning.

[10]  Andreas Girgensohn,et al.  Temporal event clustering for digital photo collections , 2003, ACM Multimedia.

[11]  Mor Naaman,et al.  Requirements for mobile photoware , 2010, Personal and Ubiquitous Computing.

[12]  Idan Szpektor,et al.  Improving Term Weighting for Community Question Answering Search Using Syntactic Analysis , 2014, CIKM.

[13]  Mor Naaman,et al.  Automatic organization for digital photographs with geographic coordinates , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[14]  Ali Farhadi,et al.  Learning to Select and Order Vacation Photographs , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[15]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[16]  M. Gabbouj,et al.  Personalized representative image selection for shared photo albums , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[17]  Eszter Hargittai,et al.  Smile, snap, and share? A nuanced approach to privacy and online photo-sharing , 2014 .

[18]  Tie-Yan Liu,et al.  Adapting ranking SVM to document retrieval , 2006, SIGIR.

[19]  Rishabh K. Iyer,et al.  Learning Mixtures of Submodular Functions for Image Collection Summarization , 2014, NIPS.

[20]  Ido Guy,et al.  Increasing Activity in Enterprise Online Communities Using Content Recommendation , 2016, ACM Trans. Comput. Hum. Interact..

[21]  Claudia Niederée,et al.  To Keep or not to Keep: An Expectation-oriented Photo Selection Method for Personal Photo Collections , 2015, ICMR.

[22]  Mary Czerwinski,et al.  PhotoTOC: automatic clustering for browsing personal photographs , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[23]  Mor Naaman,et al.  Over-exposed?: privacy patterns and considerations in online and mobile photo sharing , 2007, CHI.

[24]  Yannis Kalantidis,et al.  Tag Prediction at Flickr: A View from the Darkroom , 2016, ACM Multimedia.

[25]  Jun Li,et al.  Automatic summarization for personal digital photos , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[26]  Nuria Oliver,et al.  Supporting personal photo storytelling for social albums , 2010, ACM Multimedia.

[27]  Luming Zhang,et al.  Describing Human Aesthetic Perception by Deeply-learned Attributes from Flickr , 2016, ArXiv.

[28]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[29]  Xian-Sheng Hua,et al.  Melog: mobile experience sharing through automatic multimedia blogging , 2010, MCMC '10.

[30]  Jiebo Luo,et al.  Photo Stream Alignment and Summarization for Collaborative Photo Collection and Sharing , 2012, IEEE Transactions on Multimedia.