Image context discovery from socially curated contents

This paper proposes a novel method of discovering a set of image contents sharing a specific context (attributes or implicit meaning) with the help of image collections obtained from social curation platforms. Socially curated contents are promising to analyze various kinds of multimedia information, since they are manually filtered and organized based on specific individual preferences, interests or perspectives. Our proposed method fully exploits the process of social curation: (1) How image contents are manually grouped together by users, and (2) how image contents are distributed in the platform. Our method reveals the fact that image contents with a specific context are naturally grouped together and every image content includes really various contexts that cannot necessarily be verbalized by texts.% A preliminary experiment with a small collection of a million of images yields a promising result.

[1]  Shankar Kumar,et al.  Video suggestion and discovery for youtube: taking random walks through the view graph , 2008, WWW.

[2]  Daniel Gatica-Perez,et al.  Modeling Flickr Communities Through Probabilistic Topic-Based Analysis , 2010, IEEE Transactions on Multimedia.

[3]  Yong Rui,et al.  Towards indexing representative images on the web , 2012, ACM Multimedia.

[4]  Makoto Yamada,et al.  Exploiting socially-generated side information in dimensionality reduction , 2013, SAM '13.

[5]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[6]  Karl Stratos,et al.  Understanding and predicting importance in images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Michael A. Zarro,et al.  Social curation on the website Pinterest.com , 2012, ASIST.

[8]  Enhong Chen,et al.  Towards Annotating Media Contents through Social Diffusion Analysis , 2012, 2012 IEEE 12th International Conference on Data Mining.

[9]  Kevin Duh,et al.  Creating Stories: Social Curation of Twitter Messages , 2012, ICWSM.

[10]  Toon De Pessemier,et al.  Context aware recommendations for user-generated content on a social network site , 2009, EuroITV '09.

[11]  Kimura Akisato Social curation as corpora for large-scale multimedia content analysis , 2013 .

[12]  Heng Ji,et al.  Exploring Context and Content Links in Social Media: A Latent Space Method , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Hao Wang,et al.  Recommending Flickr groups with social topic model , 2012, Information Retrieval.

[14]  Djemel Ziou,et al.  A Graphical Model for Context-Aware Visual Content Recommendation , 2008, IEEE Transactions on Multimedia.

[15]  Koh Takeuchi,et al.  Towards Automatic Image Understanding and Mining via Social Curation , 2012, 2012 IEEE 12th International Conference on Data Mining.

[16]  Luca Chiarandini,et al.  Image ranking based on user browsing behavior , 2012, SIGIR '12.

[17]  Yasuhiro Fujiwara,et al.  Fast Algorithm for Modularity-Based Graph Clustering , 2013, AAAI.

[18]  Shengcai Liao,et al.  Flickr group recommendation based on tensor decomposition , 2010, SIGIR.

[19]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[20]  Michael A. Zarro,et al.  Wedding Dresses and Wanted Criminals: Pinterest.com as an Infrastructure for Repository Building , 2013, ICWSM.