A concept-based model for image retrieval systems

Content-based image retrieval systems are designed to retrieve images based on the high-level desires and needs of users. However, due to the use of low-level features, image retrieval systems are faced with the so-called semantic gap problem in describing high-level concepts. In order to address this critical problem, a new concept-based model is proposed in this paper. The proposed model retrieves images based on two conceptual layers. In the first layer, the object layer, the objects are detected using the discriminative part-based approach. The second layer, on the other hand, is designed to recognize visual composite, a higher level concept to specify the related co-occurring objects. In the proposed model, this concept is recognized by a new template structure including the appearance filters, constraints, and a set of parameters trained by latent SVM. Experiments are carried out on the well-known Pascal VOC dataset. Results show that the proposed model significantly outperforms the existing content-based approaches.

[1]  S. Valli,et al.  SRBIR: Semantic Region Based Image Retrieval by Extracting the Dominant Region and Semantic Learning , 2011 .

[2]  Shital A. Raut,et al.  Image Segmentation – A State-Of-Art Survey for Prediction , 2009, 2009 International Conference on Advanced Computer Control.

[3]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Djemel Ziou,et al.  A hybrid probabilistic framework for content-based image retrieval with feature weighting , 2009, Pattern Recognit..

[5]  Fei-Fei Li,et al.  Modeling mutual context of object and human pose in human-object interaction activities , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Ali Farhadi,et al.  Recognition using visual phrases , 2011, CVPR 2011.

[9]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[10]  Deva Ramanan,et al.  Detecting Actions, Poses, and Objects with Relational Phraselets , 2012, ECCV.

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[12]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[13]  Esther de Ves,et al.  Modeling user preferences in content-based image retrieval: A novel attempt to bridge the semantic gap , 2015, Neurocomputing.

[14]  Jae Won Lee,et al.  Content-based image classification using a neural network , 2004, Pattern Recognit. Lett..

[15]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[17]  George R. Thoma,et al.  A query expansion framework in image retrieval domain based on local and global analysis , 2011, Inf. Process. Manag..

[18]  Kamal Jamshidi,et al.  A semantic model for general purpose content-based image retrieval systems , 2014, Comput. Electr. Eng..

[19]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[20]  Yi Yang,et al.  Articulated pose estimation with flexible mixtures-of-parts , 2011, CVPR 2011.

[21]  Jitendra Malik,et al.  Poselets: Body part detectors trained using 3D human pose annotations , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Liu Ying,et al.  Study on Region-Based Forensic Image Retrieval , 2014, 2014 Seventh International Symposium on Computational Intelligence and Design.

[23]  Muhammad Jawad Hussain,et al.  Complementary semantic model for content-based image retrieval , 2014, 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing(ICCWAMTIP).

[24]  Ying Liu,et al.  Semantic Clustering for Region-Based Image Retrieval , 2007, Ninth IEEE International Symposium on Multimedia Workshops (ISMW 2007).

[25]  Xiaojun Qi,et al.  A novel fusion approach to content-based image retrieval , 2005, Pattern Recognit..

[26]  Chin-Wan Chung,et al.  XMage: An image retrieval method based on partial similarity , 2006, Inf. Process. Manag..

[27]  Xiaojun Qi,et al.  Incorporating multiple SVMs for automatic image annotation , 2007, Pattern Recognit..

[28]  Thorsten Joachims,et al.  Learning structural SVMs with latent variables , 2009, ICML '09.