Greedy Learning of Deep Boltzmann Machine (GDBM)’s Variance and Search Algorithm for Efficient Image Retrieval

Despite extensive research on content-based image retrieval, challenges such as low accuracy, incapability to handle complex queries and high time consumption persist. Initially, a preprocessing technique is introduced in this study, a technique that uses a median filter to remove noise to achieve improved accuracy and reliability. Then, Fourier and circularity descriptors are extract in an effective manner correspondent to the texture and affine shape adaptation features. In addition, various descriptors, such as color histogram, color moment, color autocorrelogram and color coherency vector, are extracted as the invariant color features. The multiple ant colony optimization (MACOBTC) approach is implemented with whole features to find relevant features. Finally, the relevant features are utilized for the greedy learning of deep Boltzmann machine classifier (GDBM). The proposed approach obtains effective performance and accurate results on four datasets and is analyzed with various parameters such as accuracy, precision, recall, Jaccard, Dice, and Kappa coefficients. The GDBM provides a 25% increase in accuracy compared with existing techniques, such as the a priori classification algorithm.

[1]  Shyam Krishna Nagar,et al.  Color Directional Local Quinary Patterns for Content Based Indexing and Retrieval , 2014, Human-centric Computing and Information Sciences.

[2]  Peter N. Belhumeur,et al.  POOF: Part-Based One-vs.-One Features for Fine-Grained Categorization, Face Verification, and Attribute Estimation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jian Sun,et al.  A Practical Transfer Learning Algorithm for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Naixue Xiong,et al.  EPCBIR: An efficient and privacy-preserving content-based image retrieval scheme in cloud computing , 2017, Inf. Sci..

[5]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[6]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Sanjay Silakari,et al.  Color Image Clustering using Block Truncation Algorithm , 2009, ArXiv.

[8]  Lei Zhu,et al.  Unsupervised Visual Hashing with Semantic Assistant for Content-Based Image Retrieval , 2017, IEEE Transactions on Knowledge and Data Engineering.

[9]  Nirvair Neeru,et al.  Modified SIFT Descriptors for Face Recognition under Different Emotions , 2016 .

[10]  Mahdi Rezaei,et al.  Image retrieval based on texture and color method in BTC-VQ compressed domain , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[11]  Naphtali Rishe,et al.  Content-based image retrieval , 1995, Multimedia Tools and Applications.

[12]  Fa-Xin Yu,et al.  Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ , 2011 .

[13]  Jen-Hao Hsiao,et al.  Deep learning of binary hash codes for fast image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Jing-Ming Guo,et al.  Content-Based Image Retrieval Using Error Diffusion Block Truncation Coding Features , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Chin-Chen Chang,et al.  Color image retrieval technique based on color features and image bitmap , 2007, Inf. Process. Manag..

[16]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[17]  Victor S. Lempitsky,et al.  Aggregating Local Deep Features for Image Retrieval , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Te-Wei Chiang,et al.  Content-Based Image Retrieval Via the Multiresolution Wavelet Features of Interest , 2006 .

[19]  Huailiang Liu SURVEY ON CONTENT-BASED IMAGE RETRIEVAL , 2006 .

[20]  Isma Irum,et al.  Content Based Image Retrieval by Shape , Color and Relevance Feedback , 2013 .

[21]  D. Venkata Rao,et al.  Local quantized extrema patterns for content-based natural and texture image retrieval , 2015, Human-centric Computing and Information Sciences.

[22]  Rajneesh Talwar,et al.  Content-based Image Retrieval: Feature Extraction Techniques and Applications , 2012 .

[23]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Shubha. G. Sanu,et al.  Satellite Image Mining using Content Based Image Retrieval , 2017 .

[26]  Jinjiang Wang,et al.  Deep Boltzmann machine based condition prediction for smart manufacturing , 2018, Journal of Ambient Intelligence and Humanized Computing.

[27]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[28]  Honglak Lee,et al.  Augmenting CRFs with Boltzmann Machine Shape Priors for Image Labeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Xi Zhang,et al.  Feature integration analysis of bag-of-features model for image retrieval , 2013, Neurocomputing.

[30]  Zahid Mehmood,et al.  Scene analysis and search using local features and support vector machine for effective content-based image retrieval , 2018, Artificial Intelligence Review.

[31]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[32]  S. A. Chatzichristofis,et al.  Composite Description Based on Salient Contours and Color Information for CBIR Tasks , 2019, IEEE Transactions on Image Processing.

[33]  Lei Zhang,et al.  Bit-Scalable Deep Hashing With Regularized Similarity Learning for Image Retrieval and Person Re-Identification , 2015, IEEE Transactions on Image Processing.

[34]  Honghui Fan,et al.  Separation of Vehicle Detection Area Using Fourier Descriptor Under Internet of Things Monitoring , 2018, IEEE Access.

[35]  Z. Vamossy,et al.  Sketch4match — Content-based image retrieval system using sketches , 2011, 2011 IEEE 9th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[36]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Bertrand Zavidovique,et al.  Content based image retrieval using motif cooccurrence matrix , 2004, Image Vis. Comput..

[38]  Jing-Ming Guo,et al.  Content-Based Image Retrieval Using Features Extracted From Halftoning-Based Block Truncation Coding , 2015, IEEE Transactions on Image Processing.

[39]  Jiri Matas,et al.  Learning Discriminative Affine Regions via Discriminability , 2017, ArXiv.

[40]  Rong-Tai Chen,et al.  A smart content-based image retrieval system based on color and texture feature , 2009, Image Vis. Comput..

[41]  Qingshan Liu,et al.  Face image retrieval based on shape and texture feature fusion , 2017, Computational Visual Media.

[42]  Jian Sun,et al.  Face recognition with learning-based descriptor , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Anne E. James,et al.  An efficient image retrieval scheme for colour enhancement of embedded and distributed surveillance images , 2016, Neurocomputing.

[44]  Cordelia Schmid,et al.  Convolutional Patch Representations for Image Retrieval: An Unsupervised Approach , 2016, International Journal of Computer Vision.

[45]  Po-Whei Huang,et al.  Image retrieval by texture similarity , 2003, Pattern Recognit..

[46]  Jing-Ming Guo,et al.  Effective Image Retrieval System Using Dot-Diffused Block Truncation Coding Features , 2015, IEEE Transactions on Multimedia.

[47]  Veena Bansal,et al.  PATSEEK: Content Based Image Retrieval System for Patent Database , 2004, ICEB.

[48]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[49]  Song Wang,et al.  Improved Deep Hashing With Soft Pairwise Similarity for Multi-Label Image Retrieval , 2018, IEEE Transactions on Multimedia.

[50]  Arvind Nagathan,et al.  Content-Based Image Retrieval System using Feed-Forward Backpropagation Neural Network , 2014 .

[51]  Miguel E. Ruiz,et al.  Automatic Classification of Medical Images for Content Based Image Retrieval Systems (CBIR) , 2008 .

[52]  Agma J. M. Traina,et al.  Combining Diversity Queries and Visual Mining to Improve Content-Based Image Retrieval Systems: The DiVI Method , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[53]  Rajiv Kapoor,et al.  Detection of Power Quality Event using Histogram of Oriented Gradients and Support Vector Machine , 2018 .

[54]  Li Fei-Fei,et al.  Generating Semantically Precise Scene Graphs from Textual Descriptions for Improved Image Retrieval , 2015, VL@EMNLP.

[55]  Jian Sun,et al.  An associate-predict model for face recognition , 2011, CVPR 2011.

[56]  Junseok Kim,et al.  AN EXPLICIT NUMERICAL ALGORITHM FOR SURFACE RECONSTRUCTION FROM UNORGANIZED POINTS USING GAUSSIAN FILTER , 2019 .

[57]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[58]  Peter N. Belhumeur,et al.  Tom-vs-Pete Classifiers and Identity-Preserving Alignment for Face Verification , 2012, BMVC.

[59]  Albert Gordo,et al.  Deep Image Retrieval: Learning Global Representations for Image Search , 2016, ECCV.

[60]  Wei Wei,et al.  Deep Multi-Level Semantic Hashing for Cross-Modal Retrieval , 2019, IEEE Access.

[61]  Mohammed M. Alkhawlani,et al.  Content-Based Image Retrieval using Local Features Descriptors and Bag-of-Visual Words , 2015 .

[62]  Victor S. Lempitsky,et al.  Neural Codes for Image Retrieval , 2014, ECCV.

[63]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[64]  Vandana Vinayak,et al.  CBIR System using Color Moment and Color Auto-Correlogram with Block Truncation Coding , 2017 .

[65]  Tieniu Tan,et al.  Deep semantic ranking based hashing for multi-label image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[66]  Guoping Qiu Color image indexing using BTC , 2003, IEEE Trans. Image Process..

[67]  Laurenz Wiskott,et al.  Gaussian-binary restricted Boltzmann machines for modeling natural image statistics , 2014, PloS one.

[68]  Xiaogang Wang,et al.  Recover Canonical-View Faces in the Wild with Deep Neural Networks , 2014, ArXiv.

[69]  Guizhong Liu,et al.  An improvement to the SIFT descriptor for image representation and matching , 2013, Pattern Recognit. Lett..