Fruit Defect Prediction Model (FDPM) based on Three-Level Validation

It is a known fact that infrared radiation is produced by all objects with a temperature above absolute zero. In fruits, IR light sensor senses the invisible areas and exposes obscure objects in the image. In normal RGB images, it is very difficult to predict the internal defect of the fruit accurately without chopping it into pieces. In this paper, a thermal IR imaging-based fruit defect detection technique is proposed to identify and estimate the internal defect in the pome fruits. The technique is non-invasive and non-destructive which helps in minimizing the fruit wastage during the quality check. To achieve high accuracy, a three-level validation process is adopted. First level involves the prediction made by the proposed Deep learning-based expert system using RGB and thermal images of apple respectively. In second level, the validation of results is done using Fourier Transform Infrared spectroscopy technique. And finally, in third level, an invasive destructive method is used for inspection of the fruit quality by cutting them into pieces. The apple defect detection accuracy by the proposed Naive Bayes classifier is observed to be 97.6% for thermal IR imaging samples whereas true color based achieved only 59% for the same sample. An apple seems to be healthy externally but internally there is a probability of a defect. Thermal IR imaging detects the heat from the surface of the fruit. Due to defective tissues of fruit pulp, the non-uniform temperature difference is observed and sensed on the surface of the fruit.

[1]  Federico Hahn,et al.  Actual Pathogen Detection: Sensors and Algorithms - a Review , 2009, Algorithms.

[2]  Yogesh,et al.  Computer vision based analysis and detection of defects in fruits causes due to nutrients deficiency , 2019, Cluster Computing.

[3]  Guoying Zhao,et al.  Hierarchical Contour Closure-Based Holistic Salient Object Detection. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[4]  Yung-Yao Chen,et al.  Image segmentation in thermal images , 2016, 2016 IEEE International Conference on Industrial Technology (ICIT).

[5]  Keke Zhang,et al.  Identification of peach leaf disease infected by Xanthomonas campestris with deep learning , 2019, Engineering in Agriculture, Environment and Food.

[6]  Ravibabu Mulaveesala,et al.  Applications of non-stationary thermal wave imaging methods for characterisation of fibre-reinforced plastic materials , 2013 .

[7]  A. Dempster,et al.  Modification on distance transform to avoid over-segmentation and under-segmentation , 2002, International Symposium on VIPromCom Video/Image Processing and Multimedia Communications.

[8]  K. Thangavel,et al.  Determination of curcumin, starch and moisture content in turmeric by Fourier transform near infrared spectroscopy (FT-NIR) , 2019, Engineering in Agriculture, Environment and Food.

[9]  Tingting Zhang,et al.  Improved Otsu segmentation based on sobel operator , 2016, 2016 3rd International Conference on Systems and Informatics (ICSAI).

[10]  Jie Chen,et al.  Hierarchical Contour Closure-Based Holistic Salient Object Detection , 2017, IEEE Transactions on Image Processing.

[11]  Tomasz Markiewicz,et al.  Cell segmentation in desmoglein-3 stained specimen microscopic images using GVF and watershed algorithm , 2016, 2016 17th International Conference Computational Problems of Electrical Engineering (CPEE).

[12]  Fubin Wang,et al.  Image segmentation for somatic cell of milk based on niching particle swarm optimization Otsu , 2019, Engineering in Agriculture, Environment and Food.

[13]  Zainul Abdin Jaffery,et al.  Scheme for predictive fault diagnosis in photo-voltaic modules using thermal imaging , 2017 .

[14]  H. S. Kim,et al.  FPGA-based of Thermogram Enhancement Algorithm for Non-destructive Thermal Characterization , 2018, International Journal of Engineering.

[15]  Humaira Nisar,et al.  Iterative region based Otsu thresholding of bright-field microscopic images of activated sludge , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[16]  King Ngi Ngan,et al.  Weakly Supervised Part Proposal Segmentation From Multiple Images , 2017, IEEE Transactions on Image Processing.

[17]  Hamid Hassanpour,et al.  An Improved Pixon-Based Approach for Image Segmentation , 2011 .

[18]  A. Peirs,et al.  Light penetration properties of NIR radiation in fruit with respect to non-destructive quality assessment , 2000 .

[19]  Domenec Puig,et al.  Supervised texture segmentation through a multi-level pixel-based classifier based on specifically designed filters , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Julio Molleda,et al.  Infrared Thermography for Temperature Measurement and Non-Destructive Testing , 2014, Sensors.

[21]  C. J. Prabhakar,et al.  Computer Vision Based Technique for Surface Defect Detection of Apples , 2014 .

[22]  Kui Ren,et al.  Secure Surfing: Privacy-Preserving Speeded-Up Robust Feature Extractor , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[23]  Zainul Abdin Jaffery,et al.  Design of early fault detection technique for electrical assets using infrared thermograms , 2014 .

[24]  Mohd Rizman Sultan Mohd,et al.  Application of discrete wavelet transform in thermal infrared image processing , 2016, 2016 IEEE Conference on Systems, Process and Control (ICSPC).

[25]  N. Leena,et al.  Classification of macronutrient deficiencies in maize plants using optimized multi class support vector machines , 2019, Engineering in Agriculture, Environment and Food.

[26]  M. Faundez-Zanuy,et al.  Thermal hand image segmentation for biometric recognition , 2013, IEEE Aerospace and Electronic Systems Magazine.

[27]  Henrique A. Almeida,et al.  Segmentation Algorithms for Thermal Images , 2014 .

[28]  Iman Esmaili Paeen Afrakoti,et al.  Face Recognition in Thermal Images based on Sparse Classifier , 2019 .

[29]  Md. Zainal Abedin,et al.  Traffic Sign Recognition using SURF: Speeded up robust feature descriptor and artificial neural network classifier , 2016, 2016 9th International Conference on Electrical and Computer Engineering (ICECE).

[30]  Yulong Wang,et al.  Image segmentation based on 2D OTSU and simplified swarm optimization , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[31]  V. Santhi Recent Advances in Applied Thermal Imaging for Industrial Applications , 2017 .

[32]  Ramesh R. Manza,et al.  Segmentation of Thermal Images Using Thresholding-Based Methods for Detection of Malignant Tumours , 2016 .

[33]  Karen Lucero Roldán-Serrato,et al.  Automatic pest detection on bean and potato crops by applying neural classifiers , 2018, Engineering in Agriculture, Environment and Food.

[34]  Nishchal K. Verma,et al.  Vision Based Object Counting Using Speeded Up Robust Features for Inventory Control , 2016, 2016 International Conference on Computational Science and Computational Intelligence (CSCI).