Learning to Recommend Tags for On-line Photos

Recommending text tags for on-line photos is useful for on-line photo services. We propose a novel approach to tag recommendation by utilizing both the underlying semantic correlation between visual contents and text tags and the tag popularity learnt from realistic on-line photos. We apply our approach to a database of real on-line photos and evaluate its performance by both objective and subjective evaluation. Experiwith ments demonstrate the improved performance of the proposed approach compared the state-of-the-art techniques in the literature.

[1]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[2]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[3]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[4]  Korris Fu-Lai Chung,et al.  Knowledge and Information Systems , 2017 .

[5]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[6]  Huan Liu,et al.  Blocking objectionable web content by leveraging multiple information sources , 2006, SKDD.

[7]  James Ze Wang,et al.  Real-Time Computerized Annotation of Pictures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  David M. Nichols,et al.  Implicit Rating and Filtering , 1998 .

[9]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[10]  Ole Winther,et al.  Independent component analysis for understanding multimedia content , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[11]  Nello Cristianini,et al.  Inferring a Semantic Representation of Text via Cross-Language Correlation Analysis , 2002, NIPS.

[12]  Baoxin Li,et al.  Completing missing views for multiple sources of web media , 2008, Int. J. Data Min. Model. Manag..

[13]  Roelof van Zwol,et al.  Flickr tag recommendation based on collective knowledge , 2008, WWW.

[14]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[15]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[16]  H. Hotelling Relations Between Two Sets of Variates , 1936 .