Mining user-contributed photos for personalized product recommendation

With the advent and popularity of social media, users are willing to share their experiences by photos, reviews, blogs, and so on. The social media contents shared by these users reveal potential shopping needs. Product recommender is not limited to just e-commerce sites, it can also be expanded to social media sites. In this paper, we propose a novel hierarchical user interest mining (Huim) approach for personalized products recommendation. The input of our approach consists of user-contributed photos and user generated content (UGC), which include user-annotated photo tags and the comments from others in a social site. The proposed approach consists of four steps. First, we make full use of the visual information and UGC of its photos to mine user's interest. Second, we represent user interest by a topic distribution vector, and apply our proposed Huim to enhance interest-related topics. Third, we also represent each product by a topic distribution vector. Then, we measure the relevance of user and product in the topic space and determine the rank of each product for the user. We conduct a series of experiments on Flickr users and the products from Bing Shopping. Experimental results show the effectiveness of the proposed approach.

[1]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[2]  Yukun Cao,et al.  An intelligent fuzzy-based recommendation system for consumer electronic products , 2007, Expert Syst. Appl..

[3]  Xueming Qian,et al.  Recommend Social Network Users Favorite Brands , 2013, PCM.

[4]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[5]  Wei-Ying Ma,et al.  Recommending friends and locations based on individual location history , 2011, ACM Trans. Web.

[6]  Changsheng Xu,et al.  Robust goal-mouth detection for virtual content insertion , 2003, MULTIMEDIA '03.

[7]  Chong-Wah Ngo,et al.  PageSense: style-wise web page advertising , 2010, WWW '10.

[8]  Xin Li,et al.  Tag-based social interest discovery , 2008, WWW.

[9]  Tao Mei,et al.  GameSense: game-like in-image advertising , 2009, Multimedia Tools and Applications.

[10]  Xing Xie,et al.  Learning travel recommendations from user-generated GPS traces , 2011, TIST.

[11]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[12]  Changsheng Xu,et al.  Real time advertisement insertion in baseball video based on advertisement effect , 2005, MULTIMEDIA '05.

[13]  Ja-Ling Wu,et al.  ViSA: virtual spotlighted advertising , 2008, ACM Multimedia.

[14]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[15]  Koustuv Dasgupta,et al.  User interests in social media sites: an exploration with micro-blogs , 2009, CIKM.

[16]  Duen-Ren Liu,et al.  Integrating AHP and data mining for product recommendation based on customer lifetime value , 2005, Inf. Manag..

[17]  Tao Mei,et al.  Contextual Internet Multimedia Advertising , 2010, Proceedings of the IEEE.

[18]  Wei-Ying Ma,et al.  Advertising based on users' photos , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[19]  Tao Mei,et al.  AdOn: toward contextual overlay in-video advertising , 2010, Multimedia Systems.

[20]  Andrei Z. Broder,et al.  A semantic approach to contextual advertising , 2007, SIGIR.

[21]  Wei-Ying Ma,et al.  Argo: intelligent advertising by mining a user's interest from his photo collections , 2009, KDD Workshop on Data Mining and Audience Intelligence for Advertising.

[22]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[23]  Xueming Qian,et al.  LCMKL: latent-community and multi-kernel learning based image annotation , 2013, CIKM.

[24]  Ying Li,et al.  Detecting online commercial intention (OCI) , 2006, WWW '06.

[25]  Tat-Seng Chua,et al.  Semantic-Gap-Oriented Active Learning for Multilabel Image Annotation , 2012, IEEE Transactions on Image Processing.

[26]  Bernardo A. Huberman,et al.  Predicting the Future with Social Media , 2010, Web Intelligence.

[27]  Tao Mei,et al.  Contextual in-image advertising , 2008, ACM Multimedia.

[28]  Changsheng Xu,et al.  A generic virtual content insertion system based on visual attention analysis , 2008, ACM Multimedia.

[29]  Yifan Chen,et al.  Advertising keyword suggestion based on concept hierarchy , 2008, WSDM '08.

[30]  Wei-Ying Ma,et al.  Annotating Images by Mining Image Search Results , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Munmun De Choudhury,et al.  Connecting content to community in social media via image content, user tags and user communication , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[32]  Shuicheng Yan,et al.  Inferring semantic concepts from community-contributed images and noisy tags , 2009, ACM Multimedia.

[33]  Hua Li,et al.  Demographic prediction based on user's browsing behavior , 2007, WWW '07.

[34]  Tzu-Chuen Lu,et al.  Mining association rules procedure to support on-line recommendation by customers and products fragmentation , 2001, Expert Syst. Appl..

[35]  Winston H. Hsu,et al.  AdImage: video advertising by image matching and ad scheduling optimization , 2008, SIGIR '08.

[36]  Susan Gauch,et al.  Improving Ontology-Based User Profiles , 2004, RIAO.

[37]  Tao Mei,et al.  VideoSense: A Contextual In-Video Advertising System , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[39]  François Fouss,et al.  Random-Walk Computation of Similarities between Nodes of a Graph with Application to Collaborative Recommendation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[40]  Pablo Castells,et al.  Adaptive multimedia access: from user needs to semantic personalisation , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[41]  Xueming Qian,et al.  Tag filtering based on similar compatible principle , 2012, 2012 19th IEEE International Conference on Image Processing.

[42]  Xueming Qian,et al.  Tagging photos using users' vocabularies , 2013, Neurocomputing.

[43]  Tao Mei,et al.  VideoSense: towards effective online video advertising , 2007, ACM Multimedia.

[44]  Tao Mei,et al.  When multimedia advertising meets the new Internet era , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[45]  Xueming Qian,et al.  Recommendation via user's personality and social contextual , 2013, CIKM.

[46]  P. Chatterjee,et al.  Modeling the Clickstream: Implications for Web-Based Advertising Efforts , 2003 .

[47]  Francesco Ricci,et al.  Product Recommendation with Interactive Query Management and Twofold Similarity , 2003, ICCBR.