Visual saliency guided complex image retrieval

ABSTRACT Compared with the traditional text data, multimedia data are concise and contains rich meanings, so people are more willing to use the multimedia data to store information. How to effectively retrieve information is essential. This paper proposes a novel visual saliency guided complex image retrieval model. Initially, Itti visual saliency model is presented. In this model, the overall saliency map is generated by the integration of direction, intensity and color saliency map, respectively. Then, to help describe the image pattern more clearly, we present the multi-feature fusion paradigm of images. To address the complexity of the images, we propose a two-stage definition: (1) Cognitive load based complexity; (2) Cognitive level of complexity classification. The group sparse logistic regression model is integrated to finalize the image retrieval system. The performance of the proposed system is tested on different databases compared with the other state-of-the-art models which overcome the baselines in complex scenarios.

[1]  Subrahmanyam Murala,et al.  3D Local Transform Patterns: A New Feature Descriptor for Image Retrieval , 2016, CVIP.

[2]  Chengcui Zhang,et al.  Social Media Image Retrieval Using Distilled Convolutional Neural Network for Suspicious e-Crime and Terrorist Account Detection , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[3]  Lorenzo Bruzzone,et al.  Primitive cluster sensitive hashing for scalable content-based image retrieval in remote sensing archives , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[4]  Haoxiang Wang,et al.  An Effective Image Representation Method Using Kernel Classification , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[5]  Hasan S. Bilge,et al.  Content based image retrieval with sparse representations and local feature descriptors : A comparative study , 2017, Pattern Recognit..

[6]  Haoxiang Wang,et al.  Multiple Kernel Multivariate Performance Learning Using Cutting Plane Algorithm , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[7]  Marek R. Ogiela,et al.  Beginnings of Cognitive Science , 2012 .

[8]  B. Eswara Reddy,et al.  A Key Point Selection Shape Technique for Content Based Image Retrieval System , 2016, Int. J. Comput. Vis. Image Process..

[9]  Marek R. Ogiela,et al.  Data Mining and Semantic Inference in Cognitive Systems , 2014, 2014 International Conference on Intelligent Networking and Collaborative Systems.

[10]  Xuezhi Tan,et al.  Visual Location Recognition Based on Coarse-to-Fine Image Retrieval and Epipolar Geometry Constraint for Urban Environment , 2016 .

[11]  Hao Liu,et al.  A Three-Layered Graph-Based Learning Approach for Remote Sensing Image Retrieval , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Akira Fukuda,et al.  An intelligent annotation-based image retrieval system based on RDF descriptions , 2017, Comput. Electr. Eng..

[13]  Qiang Wang,et al.  Integration of semantic and visual hashing for image retrieval , 2017, J. Vis. Commun. Image Represent..

[14]  Chandan Singh,et al.  A fast and efficient image retrieval system based on color and texture features , 2016, J. Vis. Commun. Image Represent..

[15]  Deyu Meng,et al.  Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yi Gu,et al.  Optimizing top precision performance measure of content-based image retrieval by learning similarity function , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  Ling Shao,et al.  Deep Sketch Hashing: Fast Free-Hand Sketch-Based Image Retrieval , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Wei Luo,et al.  Study on image retrieval based on image texture and color statistical projection , 2016, Neurocomputing.

[19]  Qi Tian,et al.  Scalable Feature Matching by Dual Cascaded Scalar Quantization for Image Retrieval , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Nicu Sebe,et al.  Joint Attributes and Event Analysis for Multimedia Event Detection , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Xiaojun Chang,et al.  Feature Interaction Augmented Sparse Learning for Fast Kinect Motion Detection , 2017, IEEE Transactions on Image Processing.

[22]  Zahid Mehmood,et al.  Image retrieval by addition of spatial information based on histograms of triangular regions , 2016, Comput. Electr. Eng..

[23]  Nan Mu,et al.  Hierarchical salient object detection model using contrast-based saliency and color spatial distribution , 2015, Multimedia Tools and Applications.

[24]  Yulong Xu,et al.  MS-RMAC: Multiscale Regional Maximum Activation of Convolutions for Image Retrieval , 2017, IEEE Signal Processing Letters.

[25]  Balasubramanian Raman,et al.  Multi-quantized local binary patterns for facial gender classification , 2016, Comput. Electr. Eng..

[26]  Minghui Wang,et al.  RGB-D Salient Object Detection via Minimum Barrier Distance Transform and Saliency Fusion , 2017, IEEE Signal Processing Letters.

[27]  Zhihui Li,et al.  Beyond Trace Ratio: Weighted Harmonic Mean of Trace Ratios for Multiclass Discriminant Analysis , 2017, IEEE Transactions on Knowledge and Data Engineering.

[28]  Xiang Bai,et al.  Deep sketch feature for cross-domain image retrieval , 2016, Neurocomputing.

[29]  Haoxiang Wang,et al.  Image Tag Completion by Local Learning , 2015, ISNN.

[30]  Saso Dzeroski,et al.  Improving bag-of-visual-words image retrieval with predictive clustering trees , 2016, Inf. Sci..

[31]  Henning Müller,et al.  Datasets column: diversity and credibility for social images and image retrieval , 2018, ACMMR.

[32]  Subrahmanyam Murala,et al.  Local directional mask maximum edge patterns for image retrieval and face recognition , 2016, IET Comput. Vis..

[33]  Nicu Sebe,et al.  The Many Shades of Negativity , 2017, IEEE Transactions on Multimedia.

[34]  Lihong Zhu,et al.  Color texture image retrieval based on Gaussian copula models of Gabor wavelets , 2017, Pattern Recognit..

[35]  Sanyuan Zhao,et al.  Diffusion-based saliency detection with optimal seed selection scheme , 2017, Neurocomputing.