A deep neural network and classical features based scheme for objects recognition: an application for machine inspection

Computer Vision (CV) domain is widely used in the current era of automation and visual surveillance for the detection and classification of different objects in a diverse environment. The automatic machine inspection of different objects in the scenes is based on internal and external parameters like features that provide a huge amount of information related to the nature of an object in the scene. In this work, we propose a new automated method based on classical and deep learning feature selection. The proposed object classification method follows three steps. The data augmentation is performed in the first step to make the balance database. Later, Pyramid HOG (PHOG) and Central Symmetric LBP (CS-LBP) features are serially fused along with deep learning-based extracted features. The deep learning features are extracted from the pre-trained CNN model name Inception V3. In the third step, a new technique name Joint Entropy along with KNN (JEKNN) is employed to select the best features. The best-selected features are finally classified by well-known supervised learning methods and choose the best one based on higher accuracy. The proposed method is evaluated on Caltech101 balanced dataset and achieved maximum accuracy of 90.4% on Ensemble classifier which outperforms as compare to existing techniques.

[1]  Yong Xia,et al.  Locality constrained encoding of frequency and spatial information for image classification , 2018, Multimedia Tools and Applications.

[2]  Zhenhua Guo,et al.  Joint learning for voice based disease detection , 2019, Pattern Recognit..

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Junaid Ali Khan,et al.  Human action recognition using fusion of multiview and deep features: an application to video surveillance , 2020, Multimedia Tools and Applications.

[5]  Thomas J. Watson,et al.  An empirical study of the naive Bayes classifier , 2001 .

[6]  Geoffrey C. Fox,et al.  Object Classification by a Super-resolution Method and a Convolutional Neural Networks , 2019 .

[7]  Weiwei Zhang,et al.  Real-time vehicle type classification with deep convolutional neural networks , 2017, Journal of Real-Time Image Processing.

[8]  Amit Prakash Singh,et al.  Impact of reduction in descriptor size on object detection and classification , 2018, Multimedia Tools and Applications.

[9]  Muhammad Rashid,et al.  Microscopic melanoma detection and classification: A framework of pixel‐based fusion and multilevel features reduction , 2020, Microscopy research and technique.

[10]  Tom M. Mitchell,et al.  Learning Data Manipulation for Augmentation and Weighting , 2019, NeurIPS.

[11]  Ankush Mittal,et al.  Indoor Object Classification Using Higher Dimensional MPEG Features , 2018, SocProS.

[12]  Suresh Chandra Satapathy,et al.  Gastrointestinal diseases segmentation and classification based on duo-deep architectures , 2020, Pattern Recognit. Lett..

[13]  Quoc V. Le,et al.  RandAugment: Practical data augmentation with no separate search , 2019, ArXiv.

[14]  Simon Fong,et al.  Addressing Low Dimensionality Feature Subset Selection: ReliefF(-k) or Extended Correlation-Based Feature Selection(eCFS)? , 2019, SOCO.

[15]  Wenyuan Li,et al.  Partially Occluded Head Posture Estimation for 2D Images using Pyramid HoG Features , 2019, 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[16]  Siyu Zhang,et al.  InSphereNet: a Concise Representation and Classification Method for 3D Object , 2019, MMM.

[17]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[18]  Baljit Kaur,et al.  A Convolutional Feature Map based Deep Network targeted towards Traffic Detection and Classification , 2018, Expert Syst. Appl..

[19]  Muhammad Bilal,et al.  High Performance Real-Time Pedestrian Detection Using Light Weight Features and Fast Cascaded Kernel SVM Classification , 2019, J. Signal Process. Syst..

[20]  Tanzila Saba,et al.  Region Extraction and Classification of Skin Cancer: A Heterogeneous framework of Deep CNN Features Fusion and Reduction , 2019, Journal of Medical Systems.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Zhiguo Cao,et al.  Good practices on building effective CNN baseline model for person re-identification , 2018, International Conference on Graphic and Image Processing.

[23]  Tariq Umer,et al.  Diagnosis and recognition of grape leaf diseases: An automated system based on a novel saliency approach and canonical correlation analysis based multiple features fusion , 2019, Sustain. Comput. Informatics Syst..

[24]  Subhas C. Misra,et al.  A multi-faceted CNN architecture for automatic classification of mobile LiDAR data and an algorithm to reproduce point cloud samples for enhanced training , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[25]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Sang Min Yoon,et al.  Structure preserving dimensionality reduction for visual object recognition , 2018, Multimedia Tools and Applications.

[28]  Wei Qian,et al.  Content-based image retrieval for Lung Nodule Classification Using Texture Features and Learned Distance Metric , 2017, Journal of Medical Systems.

[29]  Tanzila Saba,et al.  A Machine Learning Method with Threshold Based Parallel Feature Fusion and Feature Selection for Automated Gait Recognition , 2020, J. Organ. End User Comput..

[30]  Jamal Hussain Shah,et al.  Lungs cancer classification from CT images: An integrated design of contrast based classical features fusion and selection , 2020, Pattern Recognit. Lett..

[31]  Nawaf N. Hamadneh,et al.  Continuous versions of firefly algorithm: a review , 2017, Artificial Intelligence Review.

[32]  Nilanjan Dey,et al.  Classification of mice hepatic granuloma microscopic images based on a deep convolutional neural network , 2019, Appl. Soft Comput..

[33]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Muhammad Younus Javed,et al.  Multi-level features fusion and selection for human gait recognition: an optimized framework of Bayesian model and binomial distribution , 2019, Int. J. Mach. Learn. Cybern..

[35]  Mudassar Raza,et al.  Object detection and classification: a joint selection and fusion strategy of deep convolutional neural network and SIFT point features , 2018, Multimedia Tools and Applications.

[36]  Hossam Faris,et al.  Efficient Hybrid Nature-Inspired Binary Optimizers for Feature Selection , 2019, Cognitive Computation.

[37]  Timothy Patten,et al.  Robust 3D Object Classification by Combining Point Pair Features and Graph Convolution , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[38]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[39]  Muhammad Shaheen,et al.  Decision tree classification: Ranking journals using IGIDI , 2020, J. Inf. Sci..

[40]  Suresh Chandra Satapathy,et al.  A multilevel paradigm for deep convolutional neural network features selection with an application to human gait recognition , 2020, Expert Syst. J. Knowl. Eng..

[41]  V. Sugumaran,et al.  Machine learning approach for automated visual inspection of machine components , 2011, Expert Syst. Appl..

[42]  Xiang Li,et al.  Toward real-time 3D object recognition: A lightweight volumetric CNN framework using multitask learning , 2017, Comput. Graph..

[43]  Cheng Wang,et al.  Pyramid binary pattern features for real-time pedestrian detection from infrared videos , 2011, Neurocomputing.

[44]  Gabriele Steidl,et al.  Combined SVM-Based Feature Selection and Classification , 2005, Machine Learning.

[45]  Muhammad Awais,et al.  CCDF: Automatic system for segmentation and recognition of fruit crops diseases based on correlation coefficient and deep CNN features , 2018, Comput. Electron. Agric..

[46]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[47]  Junxuan Zhao,et al.  Automatic Vehicle Tracking With Roadside LiDAR Data for the Connected-Vehicles System , 2019, IEEE Intelligent Systems.

[48]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[49]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  A. Ben Hamza,et al.  Convolutional Shape-Aware Representation for 3D Object Classification , 2019, Neural Processing Letters.

[51]  Abdul Majid,et al.  Classification of stomach infections: A paradigm of convolutional neural network along with classical features fusion and selection , 2020, Microscopy research and technique.

[52]  Xuelong Li,et al.  Linear SVM classification using boosting HOG features for vehicle detection in low-altitude airborne videos , 2011, 2011 18th IEEE International Conference on Image Processing.

[53]  Sanchay Gupta,et al.  Optical Character Recognition on Bank Cheques Using 2D Convolution Neural Network , 2018, Advances in Intelligent Systems and Computing.

[54]  Guy W. Mineau,et al.  A simple KNN algorithm for text categorization , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[55]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[56]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[57]  Yan Zhu,et al.  Photon-limited non-imaging object detection and classification based on single-pixel imaging system , 2020 .

[58]  Tom V. Mathew Genetic Algorithm , 2022 .

[59]  Guangcan Liu,et al.  On fusing the latent deep CNN feature for image classification , 2018, World Wide Web.