Detailed Investigation of Deep Features with Sparse Representation and Dimensionality Reduction in CBIR: A Comparative Study

Research on content-based image retrieval (CBIR) has been under development for decades, and numerous methods have been competing to extract the most discriminative features for improved representation of the image content. Recently, deep learning methods have gained attention in computer vision, including CBIR. In this paper, we present a comparative investigation of different features, including low-level and high-level features, for CBIR. We compare the performance of CBIR systems using different deep features with state-of-the-art low-level features such as SIFT, SURF, HOG, LBP, and LTP, using different dictionaries and coefficient learning techniques. Furthermore, we conduct comparisons with a set of primitive and popular features that have been used in this field, including colour histograms and Gabor features. We also investigate the discriminative power of deep features using certain similarity measures under different validation approaches. Furthermore, we investigate the effects of the dimensionality reduction of deep features on the performance of CBIR systems using principal component analysis, discrete wavelet transform, and discrete cosine transform. Unprecedentedly, the experimental results demonstrate high (95\% and 93\%) mean average precisions when using the VGG-16 FC7 deep features of Corel-1000 and Coil-20 datasets with 10-D and 20-D K-SVD, respectively.

[1]  Ahmad B. A. Hassanat,et al.  Visual Speech Recognition , 2011, ArXiv.

[2]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Hermann Ney,et al.  Features for image retrieval: an experimental comparison , 2008, Information Retrieval.

[4]  Michael Elad,et al.  L1-L2 Optimization in Signal and Image Processing , 2010, IEEE Signal Processing Magazine.

[5]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Gwénolé Quellec,et al.  Deep image mining for diabetic retinopathy screening , 2016, Medical Image Anal..

[7]  Ahmad Basheer Hassanat,et al.  Dimensionality Invariant Similarity Measure , 2014, ArXiv.

[8]  Mehmet A. Orgun,et al.  A novel biomedical image indexing and retrieval system via deep preference learning , 2018, Comput. Methods Programs Biomed..

[9]  Gwangil Jeon,et al.  Content Based Image Retrieval by Using Color Descriptor and Discrete Wavelet Transform , 2018, Journal of Medical Systems.

[10]  Xiaodong Liu,et al.  A new fusion approach for content based image retrieval with color histogram and local directional pattern , 2016, International Journal of Machine Learning and Cybernetics.

[11]  Mong-Li Lee,et al.  Image Mining: Trends and Developments , 2002, Journal of Intelligent Information Systems.

[12]  Robust Single Image Super-Resolution via Deep Networks With Sparse Prior. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[13]  Swati Agarwal,et al.  Content Based Image Retrieval using Color Edge Detection and Discrete Wavelet Transform , 2014, 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT).

[14]  V. B. Surya Prasath,et al.  Distance and Similarity Measures Effect on the Performance of K-Nearest Neighbor Classifier - A Review , 2017, Big Data.

[15]  Anastasios Tefas,et al.  Deep convolutional learning for Content Based Image Retrieval , 2018, Neurocomputing.

[16]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  V. B. Surya Prasath,et al.  Classification and gender recognition from veiled-faces , 2017, Int. J. Biom..

[18]  Xuelong Li,et al.  Efficient HOG human detection , 2011, Signal Process..

[19]  Rupali Desai,et al.  Gist, HOG, and DWT-Based Content-Based Image Retrieval for Facial Images , 2017 .

[20]  M. Esmel ElAlami,et al.  A new matching strategy for content based image retrieval system , 2014, Appl. Soft Comput..

[21]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Dmitry Chetverikov,et al.  Stability and reduction of statistical features for image classification and retrieval: Preliminary results , 2018, 2018 9th International Conference on Information and Communication Systems (ICICS).

[23]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Guojun Lu,et al.  Content-based Image Retrieval Using Gabor Texture Features , 2000 .

[25]  Xiangyang Wang,et al.  An effective image retrieval scheme using color, texture and shape features , 2011, Comput. Stand. Interfaces.

[26]  Maneesha Gupta,et al.  Analysis Of Image Compression Algorithm Using DCT , 2012 .

[27]  P. Ganesh Kumar,et al.  Content based image retrieval using deep learning process , 2018, Cluster Computing.

[28]  Shengping Zhang,et al.  Sparse coding based visual tracking: Review and experimental comparison , 2013, Pattern Recognit..

[29]  Hasan S. Bilge,et al.  Content based image retrieval with sparse representations and local feature descriptors : A comparative study , 2017, Pattern Recognit..

[30]  Joni-Kristian Kämäräinen,et al.  Simple Gabor feature space for invariant object recognition , 2004, Pattern Recognit. Lett..

[31]  Shan Li,et al.  Complex Zernike Moments Features for Shape-Based Image Retrieval , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[33]  Shubha. G. Sanu,et al.  Satellite Image Mining using Content Based Image Retrieval , 2017 .

[34]  J.S. Jin,et al.  Fast content-based image retrieval using quasi-Gabor filter and reduction of image feature dimension , 2002, Proceedings Fifth IEEE Southwest Symposium on Image Analysis and Interpretation.

[35]  Dmitry Chetverikov,et al.  Pilot Comparative Study of Different Deep Features for Palmprint Identification in Low-Quality Images , 2018, ArXiv.

[36]  V. B. Surya Prasath,et al.  Magnetic energy-based feature extraction for low-quality fingerprint images , 2018, Signal, Image and Video Processing.

[37]  Prashant Srivastava,et al.  Content-Based Image Retrieval using Local Binary Curvelet Co-occurrence Pattern - A Multiresolution Technique , 2018, Comput. J..

[38]  Hanan Samet,et al.  Content-based image retrieval using Fourier descriptors on a logo database , 2002, Object recognition supported by user interaction for service robots.

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[41]  Laurence T. Yang,et al.  A survey on deep learning for big data , 2018, Inf. Fusion.

[42]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[43]  Mahmoud B. Alhasanat,et al.  Victory sign biometrie for terrorists identification: Preliminary results , 2017, 2017 8th International Conference on Information and Communication Systems (ICICS).

[44]  Nanning Zheng,et al.  Learning group-based dictionaries for discriminative image representation , 2014, Pattern Recognit..

[45]  P.S. Hiremath,et al.  Content Based Image Retrieval Using Color, Texture and Shape Features , 2007, 15th International Conference on Advanced Computing and Communications (ADCOM 2007).

[46]  Qinghua Hu,et al.  Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO , 2015, IEEE Transactions on Multimedia.

[47]  Praveen Bhanodiya,et al.  An Effective Content-Based Image Retrieval Using Color, Texture and Shape Feature , 2013, ICACNI.

[48]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[49]  Q. M. Jonathan Wu,et al.  Modified color motif co-occurrence matrix for image indexing and retrieval , 2013, Comput. Electr. Eng..

[50]  Hossein Nezamabadi-pour,et al.  A simultaneous feature adaptation and feature selection method for content-based image retrieval systems , 2013, Knowl. Based Syst..

[51]  Rama Chellappa,et al.  Deep feature extraction in the DCT domain , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[52]  Saeid Nahavandi,et al.  A sequential search-space shrinking using CNN transfer learning and a Radon projection pool for medical image retrieval , 2018, Expert Syst. Appl..

[53]  Bertrand Zavidovique,et al.  Content based image retrieval using motif cooccurrence matrix , 2004, Image Vis. Comput..

[54]  William M. Wells,et al.  Medical Image Analysis - past, present, and future , 2016, Medical Image Anal..

[55]  Stan Z. Li,et al.  Learning Stacked Image Descriptor for Face Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Matthieu Cord,et al.  Learning Deep Hierarchical Visual Feature Coding , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Aggelos K. Katsaggelos,et al.  Video Super-Resolution With Convolutional Neural Networks , 2016, IEEE Transactions on Computational Imaging.

[58]  A. K. Pal,et al.  A novel image retrieval scheme using gray level co-occurrence matrix descriptors of discrete cosine transform based residual image , 2018, Applied Intelligence.

[59]  David Reich,et al.  Principal component analysis of genetic data , 2008, Nature Genetics.

[60]  Muhammad Kamal Hossen,et al.  A surveillance system based on motion detection and motion estimation using optical flow , 2016, 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV).

[61]  Zhihua Xia,et al.  A Privacy-Preserving and Copy-Deterrence Content-Based Image Retrieval Scheme in Cloud Computing , 2016, IEEE Transactions on Information Forensics and Security.

[62]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[63]  Maruthamuthu Ramasamy,et al.  An Edge Directed Gabor Features for Efficient Image Retrieval , 2022 .