Hybrid Approach to Content-Based Image Retrieval Using Modified Multi-Scale LBP and Color Features

The objective of the content-based image retrieval (CBIR) system is to retrieve the visually identical images from the database efficiently and effectively. It is a broad research realm with the availability of numerous applications. Performance dependence of CBIR focuses on the extraction, reduction, and selection of the features along with the practice of classification technique. In this work, we have proposed the hybrid approach of two different feature descriptors: global color histogram and multi-scale local binary pattern (MS-LBP); furthermore, the use of PCA for dimension reduction and LDA for the selection of features. The proposed method is evaluated concerning various benchmark datasets, viz., Corel-1k, Corel-5k, Corel-10k, and Ghim-10k together with result comparison based on the precision and recall values at different thresholds. The classification purposes are satisfied with Euclidean and City Block distance. The performance study of the proposed work displays it as outperformer than the identified state-of-the-art literature.

[1]  Subrahmanyam Murala,et al.  Local extrema co-occurrence pattern for color and texture image retrieval , 2015, Neurocomputing.

[2]  A Vasuki,et al.  An optimized feature selection CBIR technique using ANN , 2017, 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT).

[3]  Shiv Ram Dubey,et al.  Boosting local binary pattern with bag-of-filters for content based image retrieval , 2015, 2015 IEEE UP Section Conference on Electrical Computer and Electronics (UPCON).

[4]  Arnaldo de Albuquerque Araújo,et al.  Nude Detection in Video Using Bag-of-Visual-Features , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.

[5]  Carla E. Brodley,et al.  Testing for human perceptual categories in a physician-in-the-loop CBIR system for medical imagery , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[6]  Meng Zhao,et al.  A novel image retrieval method based on multi-trend structure descriptor , 2016, J. Vis. Commun. Image Represent..

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[9]  Qi Tian,et al.  Recent Advance in Content-based Image Retrieval: A Literature Survey , 2017, ArXiv.

[10]  Prashant Srivastava,et al.  Utilizing multiscale local binary pattern for content-based image retrieval , 2017, Multimedia Tools and Applications.

[11]  Haider Banka,et al.  A hierarchical CBIR framework using adaptive tetrolet transform and novel histograms from color and shape features , 2018, Digit. Signal Process..

[12]  Peiquan Jin,et al.  Multi-Scale Local Spatial Binary Patterns for Content-Based Image Retrieval , 2013, AMT.

[13]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[14]  Anastasios Tefas,et al.  Deep convolutional learning for Content Based Image Retrieval , 2018, Neurocomputing.

[15]  Yuxiao Hu,et al.  Efficient propagation for face annotation in family albums , 2004, MULTIMEDIA '04.

[16]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Rehan Ashraf,et al.  Content based image retrieval system by using HSV color histogram, discrete wavelet transform and edge histogram descriptor , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[18]  Sonja Zillner,et al.  Semantics and CBIR: a medical imaging perspective , 2008, CIVR '08.

[19]  Symeon Papadopoulos,et al.  Towards content-based patent image retrieval: A framework perspective , 2010 .

[20]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[21]  Rassoul Amirfattahi,et al.  A New Content-Based Image Retrieval System Based on Optimized Integration of DCD , Wavelet and Curvelet Features , 2016 .

[22]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[23]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[24]  Md. Wasi Ul Kabir,et al.  A noble color-texture hybrid method for content-based image retrieval , 2017, 2017 20th International Conference of Computer and Information Technology (ICCIT).

[25]  Albert Gordo,et al.  End-to-End Learning of Deep Visual Representations for Image Retrieval , 2016, International Journal of Computer Vision.

[26]  Effat Naaz,et al.  Enhanced content based image retrieval using machine learning techniques , 2017, 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[27]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, AMFG.

[28]  Paul H. Lewis,et al.  Surveying the Reality of Semantic Image Retrieval , 2005, VISUAL.

[29]  Govind Narayan Purohit,et al.  Impact of CBIR journey in satellite imaging , 2016 .

[30]  Hermann Ney,et al.  Features for image retrieval: an experimental comparison , 2008, Information Retrieval.

[31]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[32]  Jun Huang,et al.  An improved local binary pattern operator for texture classification , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Manish Dixit,et al.  An enhanced CBIR using HSV quantization, discrete wavelet transform and edge histogram descriptor , 2017, 2017 International Conference on Computing, Communication and Automation (ICCCA).

[34]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[35]  P. Ganesh Kumar,et al.  Content based image retrieval using deep learning process , 2018, Cluster Computing.

[36]  Margaret E. Graham,et al.  The cataloguing and indexing of images: time for a new paradigm? , 2001, Art Libraries Journal.

[37]  Hong Shao,et al.  Image Retrieval Based on MPEG-7 Dominant Color Descriptor , 2008, 2008 The 9th International Conference for Young Computer Scientists.

[38]  Bertrand Zavidovique,et al.  Region-based CBIR in GIS with local space filling curves to spatial representation , 2006, Pattern Recognit. Lett..

[39]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[40]  Vipin Tyagi,et al.  Content-Based Image Retrieval , 2017, Springer Singapore.

[41]  Xi Zhang,et al.  Feature integration analysis of bag-of-features model for image retrieval , 2013, Neurocomputing.

[42]  Amit Chhabra,et al.  A hybrid approach for improving Content Based Image Retrieval systems , 2015, 2015 1st International Conference on Next Generation Computing Technologies (NGCT).

[43]  Shiv Ram Dubey,et al.  Rotation and scale invariant hybrid image descriptor and retrieval , 2015, Comput. Electr. Eng..

[44]  Prashant Srivastava,et al.  Content-Based Image Retrieval Using Moments of Local Ternary Pattern , 2013, Mobile Networks and Applications.

[45]  Krassimira Ivanova,et al.  Color Harmonies and Contrasts Search in Art Image Collections , 2009, 2009 First International Conference on Advances in Multimedia.

[46]  G. Schaefer,et al.  Content-based image retrieval for medical infrared images , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[47]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[48]  Miguel E. Ruiz,et al.  Combining Image Features, Case Descriptions and UMLS Concepts to Improve Retrieval of Medical Images , 2006, AMIA.

[49]  Prashant Srivastava,et al.  Content-based image retrieval using multiresolution speeded-up robust feature , 2018 .

[50]  James Ze Wang,et al.  Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  M. Esmel ElAlami,et al.  A novel image retrieval model based on the most relevant features , 2011, Knowl. Based Syst..

[52]  Yan Zhou,et al.  Hierarchical Visual Perception and Two-Dimensional Compressive Sensing for Effective Content-Based Color Image Retrieval , 2016, Cognitive Computation.

[53]  Arnaldo de Albuquerque Araújo,et al.  A bag-of-features approach based on Hue-SIFT descriptor for nude detection , 2009, 2009 17th European Signal Processing Conference.

[54]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[55]  Christian E. Portugal-Zambrano,et al.  M-CBIR: A Medical Content-Based Image Retrieval System Using Metric Data-Structures , 2011, 2011 30th International Conference of the Chilean Computer Science Society.

[56]  Ying Liu,et al.  Integrating object ontology and region semantic template for crime scene investigation image retrieval , 2017, 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[57]  Xiaodong Liu,et al.  Image retrieval based on effective feature extraction and diffusion process , 2018, Multimedia Tools and Applications.

[58]  L. Rodney Long,et al.  Bridging the Gap: Enabling CBIR in Medical Applications , 2008, 2008 21st IEEE International Symposium on Computer-Based Medical Systems.

[59]  Jasman Pardede,et al.  Re-weighting Relevance Feedback in HSV Quantization for CBIR , 2018, 2018 19th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[60]  Xiaodong Liu,et al.  A new fusion approach for content based image retrieval with color histogram and local directional pattern , 2016, International Journal of Machine Learning and Cybernetics.

[61]  K. J. Mathai,et al.  An Efficient Content Based Image Retrieval System Based on Color Space Approach Using Color Histogram and Color Correlogram , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[62]  Prashant Srivastava,et al.  Content-Based Image Retrieval using moments of wavelet transform , 2014, The 2014 International Conference on Control, Automation and Information Sciences (ICCAIS 2014).

[63]  V. Nagarajan,et al.  Local Smoothness Pattern for content based image retrieval , 2015, 2015 International Conference on Communications and Signal Processing (ICCSP).

[64]  Prashant Srivastava,et al.  Content-Based Image Retrieval Using Moments , 2013, ICCASA.

[65]  Hai Jin,et al.  Content-Based Design Patent Image Retrieval Using Structured Features and Multiple Feature Fusion , 2011, 2011 Sixth International Conference on Image and Graphics.

[66]  Andrea F. Abate,et al.  FACES: 3D FAcial reConstruction from anciEnt Skulls using content based image retrieval , 2004, J. Vis. Lang. Comput..

[67]  Shyam Krishna Nagar,et al.  Color Directional Local Quinary Patterns for Content Based Indexing and Retrieval , 2014, Human-centric Computing and Information Sciences.

[68]  Oksam Chae,et al.  Local Directional Pattern (LDP) – A Robust Image Descriptor for Object Recognition , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[69]  Malay Kumar Kundu,et al.  A graph-based relevance feedback mechanism in content-based image retrieval , 2015, Knowl. Based Syst..

[70]  V. Nagarajan,et al.  Local curve pattern for content-based image retrieval , 2018, Pattern Analysis and Applications.

[71]  Bonnie Holt,et al.  Retrieving art images by image content: the UC Davis QBIC project , 1994 .

[72]  Bachir Boucheham,et al.  Adaptive content based image retrieval based on RICE algorithm selection model , 2018, 2018 International Symposium on Programming and Systems (ISPS).

[73]  Alberto Del Bimbo,et al.  Visible Image Retrieval , 2002 .

[74]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[75]  Veena Bansal,et al.  PATSEEK: Content Based Image Retrieval System for Patent Database , 2004, ICEB.

[76]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[77]  Jane List,et al.  How drawings could enhance retrieval in mechanical and device patent searching , 2007 .

[78]  L. Pratap Reddy,et al.  Local mesh quantized extrema patterns for image retrieval , 2016, SpringerPlus.

[79]  P. L. K. Priyadarsini,et al.  An intelligent system of content-based image retrieval for crime investigation , 2015, Int. J. Adv. Intell. Paradigms.

[80]  Hassan Farsi,et al.  Content-based image retrieval by combining convolutional neural networks and sparse representation , 2019, Multimedia Tools and Applications.

[81]  Jing-Yu Yang,et al.  Content-based image retrieval using computational visual attention model , 2015, Pattern Recognit..

[82]  Jon Almazán,et al.  Learning With Average Precision: Training Image Retrieval With a Listwise Loss , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).