Symmetric Image Contents Analysis and Retrieval Using Decimation, Pattern Analysis, Orientation, and Features Fusion

Image retrieval procedures locate interest points and consider the features as the visual property of an image in computer vision. These primitive features define visual attributes as local or global features for content based image retrieval. The visual attributes of an image, include spatial information, shape, texture, object and color, describe the image category. The present research contributes feature detector by performing non-max suppression after detecting edges and corners based on corner score and pixel derivation-based shapes on intensity-based interest points. Thereafter, interest point description applied on interest point features set by applying symmetric sampling to cascade matching produced by validating dense distributed receptive fields after estimating perifoveal receptive fields. Spatial color-based features vector are fused with retinal and color-based feature vector extracted after applying L2 normalization on spatially arranged color image. Dimensions are reduced by applying PCA on massive feature vectors produced after symmetric sampling and transmitted to bag-of-word in fused form for indexing and retrieval of images. Extensive experiments are performed on well-known benchmarks corel-1000, core-10000, caltech-101, image net, alot, coil, ftvl, 102-flowers and 17-flowers. In order to measure the competitiveness, we designed a comparison of proposed method with seven descriptors and detectors RGBLBP, LBP, surf, sift, DoG, HoG and MSER. The proposed method reports remarkable AP, AR, ARP, ARR, P&R, mAP and mAR rates in many categories of image datasets.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yong Man Ro,et al.  Using colour local binary pattern features for face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  J. G. Carbonell,et al.  Catalogue of Artificial Intelligence Tools , 1986, Symbolic Computation.

[5]  Usman Qamar,et al.  Texture Classification Using Rotation- and Scale-Invariant Gabor Texture Features , 2013, IEEE Signal Processing Letters.

[6]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[7]  Mutasem K. Alsmadi,et al.  Content-Based Image Retrieval Using Color, Shape and Texture Descriptors and Features , 2020, Arabian Journal for Science and Engineering.

[8]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[9]  Óscar Martínez Mozos,et al.  A comparative evaluation of interest point detectors and local descriptors for visual SLAM , 2010, Machine Vision and Applications.

[10]  James Ze Wang,et al.  Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Gertjan J. Burghouts,et al.  Material-specific adaptation of color invariant features , 2009, Pattern Recognit. Lett..

[12]  Xuelong Li,et al.  Texture Classification and Retrieval Using Shearlets and Linear Regression , 2015, IEEE Transactions on Cybernetics.

[13]  Lifang Yang,et al.  Content Retrieval Algorithm Based on Improved HOG , 2015, 2015 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence.

[14]  S. Padmavathi,et al.  Analysis of Harris corner detection for color images , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[15]  Andrew Zisserman,et al.  A Visual Vocabulary for Flower Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Xi Zhang,et al.  Feature integration analysis of bag-of-features model for image retrieval , 2013, Neurocomputing.

[17]  R. Samson Ravindran,et al.  Image Retrieval Based on Local Mesh Vector Co-occurrence Pattern for Medical Diagnosis from MRI Brain Images , 2017, Journal of Medical Systems.

[18]  Niraj Kumar,et al.  Content-based image retrieval using local texture features in distributed environment , 2020, Int. J. Wavelets Multiresolution Inf. Process..

[19]  Shervan Fekri Ershad,et al.  Texture image Classification based on improved local Quinary patterns , 2019, Multimedia Tools and Applications.

[20]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[21]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  Yu Wang,et al.  Path Generation of Autonomous Approach to a Moving Ship for Unmanned Vehicles , 2015, IEEE Transactions on Industrial Electronics.

[23]  Dieter Fox,et al.  Unsupervised Feature Learning for RGB-D Based Object Recognition , 2012, ISER.

[24]  Ali Behnam,et al.  Automated progress monitoring system for linear infrastructure projects using satellite remote sensing , 2016 .

[25]  Gang Wang,et al.  Video Tracking Using Learned Hierarchical Features , 2015, IEEE Transactions on Image Processing.

[26]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  Hervé Jégou,et al.  A Comparison of Dense Region Detectors for Image Search and Fine-Grained Classification , 2014, IEEE Transactions on Image Processing.

[28]  Nam-Chul Kim,et al.  Content-based image retrieval using combined texture and color features based on multi-resolution multi-direction filtering and color autocorrelogram , 2019, Journal of Ambient Intelligence and Humanized Computing.

[29]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  E. Sreenivasa Reddy,et al.  An Efficient Multi Object Image Retrieval System Using Multiple Features and SVM , 2015, SIRS.

[31]  Reinhard Klette,et al.  Robustness of Point Feature Detection , 2013, CAIP.

[32]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[33]  David J. Harding,et al.  Automatic Image Registration of Multimodal Remotely Sensed Data With Global Shearlet Features , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Farshad Tajeri pour,et al.  Texture classification approach based on combination of random threshold vector technique and co-occurrence matrixes , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[35]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[36]  Jerry D. Gibson,et al.  Global Motion Assisted Low Complexity Video Encoding for UAV Applications , 2015, IEEE Journal of Selected Topics in Signal Processing.

[37]  Shervan Fekri Ershad,et al.  Content-based image retrieval based on combination of texture and colour information extracted in spatial and frequency domains , 2019, Electron. Libr..

[38]  Bertrand Zavidovique,et al.  Content based image retrieval using motif cooccurrence matrix , 2004, Image Vis. Comput..

[39]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[41]  Lorenzo Torresani,et al.  Classemes and Other Classifier-Based Features for Efficient Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Jun Liu,et al.  A detection and recognition system of pointer meters in substations based on computer vision , 2020 .

[43]  Witold Pedrycz,et al.  An application of chain code-based local descriptor and its extension to face recognition , 2017, Pattern Recognit..

[44]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Cordelia Schmid,et al.  Circulant Temporal Encoding for Video Retrieval and Temporal Alignment , 2015, International Journal of Computer Vision.

[46]  Shervan Fekri Ershad,et al.  Image retrieval approach based on local texture information derived from predefined patterns and spatial domain information , 2019, ArXiv.

[47]  Roland Siegwart,et al.  Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments , 2014, IEEE Robotics & Automation Magazine.

[48]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[49]  Qi Tian,et al.  Bundled Local Features for Image Representation , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[50]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Tae-Sun Choi,et al.  Embedding neural networks for semantic association in content based image retrieval , 2014, Multimedia Tools and Applications.

[52]  Junjun Jiang,et al.  Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Wen-June Wang,et al.  Human Posture Recognition Based on Images Captured by the Kinect Sensor , 2016 .

[54]  Adel M. Alimi,et al.  Video stabilization with moving object detecting and tracking for aerial video surveillance , 2014, Multimedia Tools and Applications.

[55]  Guodong Guo,et al.  Evaluating spatiotemporal interest point features for depth-based action recognition , 2014, Image Vis. Comput..

[56]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..