Image recommendation based on keyword relevance using absorbing Markov chain and image features

Image recommendation is an important feature of search engine, as tremendous amount of images are available online. It is necessary to retrieve relevant images to meet the user’s requirement. In this paper, we present an algorithm image recommendation with absorbing Markov chain (IRAbMC) to retrieve relevant images for a user’s input query. Images are ranked by calculating keyword relevance probability between annotated keywords from log and keywords of user input query. Keyword relevance is computed using absorbing Markov chain. Images are reranked using image visual features. Experimental results show that the IRAbMC algorithm outperforms Markovian semantic indexing (MSI) method with improved relevance score of retrieved ranked images.

[1]  Cordelia Schmid,et al.  TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Fatos T. Yarman-Vural,et al.  Automatic Image Annotation by Ensemble of Visual Descriptors , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jing-Ming Guo,et al.  Content-Based Image Retrieval Using Features Extracted From Halftoning-Based Block Truncation Coding , 2015, IEEE Transactions on Image Processing.

[4]  Vladimir Pavlovic,et al.  A New Baseline for Image Annotation , 2008, ECCV.

[5]  Lei Zhang,et al.  A Unified Relevance Feedback Framework for Web Image Retrieval , 2009, IEEE Transactions on Image Processing.

[6]  Barry Smyth,et al.  A Community-Based Approach to Personalizing Web Search , 2007, Computer.

[7]  Keon Stevenson,et al.  Comparative evaluation of Web image search engines for multimedia applications , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Sudeep D. Thepade,et al.  Image Retrieval with Shape Features Extracted using Gradient Operators and Slope Magnitude Technique with BTC , 2010 .

[9]  Changhu Wang,et al.  Content-Based Image Annotation Refinement , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Stefan Conrad,et al.  Extracting contextual information from multiuser systems for improving annotation-based retrieval of image data , 2008, MIR '08.

[11]  Wei-Ying Ma,et al.  Duplicate-Search-Based Image Annotation Using Web-Scale Data , 2012, Proceedings of the IEEE.

[12]  Joo-Hwee Lim,et al.  Latent semantic fusion model for image retrieval and annotation , 2007, CIKM '07.

[13]  James Ze Wang,et al.  Real-Time Computerized Annotation of Pictures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[15]  Xiongfei Li,et al.  Multimodal Image Retrieval Based on Annotation Keywords and Visual Content , 2009, 2009 IITA International Conference on Control, Automation and Systems Engineering (case 2009).

[16]  Md. Monirul Islam,et al.  Structural image retrieval using automatic image annotation and region based inverted file , 2013, J. Vis. Commun. Image Represent..

[17]  Alaa Mohamed Riad,et al.  Web Image Retrieval Search Engine based on Semantically Shared Annotation , 2012 .

[18]  Jalel Akaichi,et al.  A New CBIR Approach for the Annotation of Medical Images , 2013 .

[19]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[20]  Michela Bertolotto,et al.  Task-based annotation and retrieval for image information management , 2010, Multimedia Tools and Applications.

[21]  Mark J. Huiskes,et al.  The MIR flickr retrieval evaluation , 2008, MIR '08.

[22]  T DumaisSusan,et al.  Using linear algebra for intelligent information retrieval , 1995 .

[23]  Changsheng Xu,et al.  Learn to Personalized Image Search From the Photo Sharing Websites , 2012, IEEE Transactions on Multimedia.

[24]  Adil Alpkocak,et al.  An expansion and reranking approach for annotation-based image retrieval from Web , 2011, Expert Syst. Appl..

[25]  Eric R. Zieyel.  Operations research : applications and algorithms , 1988 .

[26]  Ilaria Bartolini,et al.  Multi-dimensional keyword-based image annotation and search , 2010, KEYS '10.

[27]  Zhenjun Tang,et al.  Combining Generative/Discriminative Learning for Automatic Image Annotation and Retrieval , 2012 .

[28]  Jianping Fan,et al.  An Interactive Approach for Filtering Out Junk Images From Keyword-Based Google Search Results , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  George R. Thoma,et al.  A Learning-Based Similarity Fusion and Filtering Approach for Biomedical Image Retrieval Using SVM Classification and Relevance Feedback , 2011, IEEE Transactions on Information Technology in Biomedicine.

[30]  B. G. Prasad,et al.  Automated Image Annotation for Semantic Indexing and Retrieval of Medical Images , 2012 .

[31]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Kien A. Hua,et al.  Fast Query Point Movement Techniques for Large CBIR Systems , 2009, IEEE Transactions on Knowledge and Data Engineering.

[33]  Mansour Jamzad,et al.  Fast Content Based Color Image Retrieval System Based on Texture Analysis of Edge Map , 2011 .

[34]  Jiawei Han,et al.  Learning a Maximum Margin Subspace for Image Retrieval , 2008, IEEE Transactions on Knowledge and Data Engineering.

[35]  Fei-Fei Li,et al.  OPTIMOL: Automatic Online Picture Collection via Incremental Model Learning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Jianping Fan,et al.  Integrating Concept Ontology and Multitask Learning to Achieve More Effective Classifier Training for Multilevel Image Annotation , 2008, IEEE Transactions on Image Processing.

[37]  C. V. Jawahar,et al.  Image Annotation Using Metric Learning in Semantic Neighbourhoods , 2012, ECCV.

[38]  Stefanos D. Kollias,et al.  Mining User Queries with Markov Chains: Application to Online Image Retrieval , 2013, IEEE Transactions on Knowledge and Data Engineering.

[39]  Mathias Lux,et al.  Content based image retrieval with LIRe , 2011, ACM Multimedia.