Personalized image recommendation and retrieval via latent SVM based model

In this paper, we investigate a problem of personalized predicting what images are likely to appear on the Web, given a query word and a database of historical images for multiple users. Inspired by recently emerging interests on personalized image search in information retrieval research, the proposed method can infer users' implicit search intent better and provide more engaging search results according to trends of Web user photos. Firstly, we collect a user historical dataset including 40 users and a panorama recommendation test dataset including 240 pictures, both of which are thoroughly divided into 5 categories, including sky, stone, plant, water, buildings. Second, we develop a predictive framework based on the latent SVM model to retrieve the most relevant images from the dataset at an individual user level, which models the relations between scene-level features and the global-level features that influence it in a globally optimal way. The experimental results on the dataset have validated the effectiveness of the proposed approaches in images recommendation.

[1]  Hao Su,et al.  Objects as Attributes for Scene Classification , 2010, ECCV Workshops.

[2]  Subhransu Maji,et al.  Detecting People Using Mutually Consistent Poselet Activations , 2010, ECCV.

[3]  Alexander C. Berg,et al.  Automatic Attribute Discovery and Characterization from Noisy Web Data , 2010, ECCV.

[4]  Meng Wang,et al.  Video accessibility enhancement for hearing-impaired users , 2011, TOMCCAP.

[5]  Shuicheng Yan,et al.  Inferring semantic concepts from community-contributed images and noisy tags , 2009, ACM Multimedia.

[6]  Tao Mei,et al.  SocialTransfer: cross-domain transfer learning from social streams for media applications , 2012, ACM Multimedia.

[7]  Eric P. Xing,et al.  Time-sensitive web image ranking and retrieval via dynamic multi-task regression , 2013, WSDM '13.

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Xiao-Yong Wei,et al.  Mining in-class social networks for large-scale pedagogical analysis , 2012, ACM Multimedia.

[10]  Meng Wang,et al.  In-Image Accessibility Indication , 2010, IEEE Transactions on Multimedia.

[11]  De Xu,et al.  Beyond tag relevance: integrating visual attention model and multi-instance learning for tag saliency ranking , 2010, CIVR '10.

[12]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Qiang Chen,et al.  Object-Layout-Aware Image Retrieval for Personal Album Management , 2012, ECCV Workshops.

[14]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[15]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Yang Wang,et al.  A Discriminative Latent Model of Object Classes and Attributes , 2010, ECCV.

[18]  Li Fei-Fei,et al.  Simple line drawings suffice for functional MRI decoding of natural scene categories , 2011, Proceedings of the National Academy of Sciences.

[19]  B. Grant,et al.  Prevalence, correlates, disability, and comorbidity of DSM-IV drug abuse and dependence in the United States: results from the national epidemiologic survey on alcohol and related conditions. , 2007, Archives of general psychiatry.

[20]  Tat-Seng Chua,et al.  Image Annotation by Graph-Based Inference With Integrated Multiple/Single Instance Representations , 2010, IEEE Transactions on Multimedia.

[21]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Chun-Shien Lu,et al.  Constraint-optimized keypoint inhibition/insertion attack: security threat to scale-space image feature extraction , 2012, ACM Multimedia.