Comparison between soft computing methods for tomato quality grading using machine vision

The combination of machine vision and soft computing approaches in the agriculture industry, using training data and automation, can improve processing times by eliminating time consuming manual assessment. The tomato is one of the most popular and highest selling fruits in the world, and its quality is judged by its visual characteristics. Classification of tomatoes into quality grades is therefore very important. In this study, we proposed a series of methods for predicting tomato quality classes based on artificial intelligence. We implemented a multi-layer architecture of a SUB-adaptive neuro fuzzy inference system (MLA-ANFIS) approach using various combinations of multiple input features, neural networks, regression and extreme learning machines (ELMs) based on a tomato image data set with seven input features that were collected from a farm. A deep stacked sparse auto-encoders (DSSAEs) method was proposed for tomato quality grading using image data directly, instead of analysing features extracted from the tomato images. The DSSAEs method was more accurate than previous methods, and used different methodology to previously proposed approaches for the evaluation of the tomato quality grades. The proposed method achieved a sensitivity of 83.2%, specificity of 96.50% and g-mean of 89.40% with accuracy of 95.5%. It may thus be able to improve inspection and quality processing of tomatoes.

[1]  Cao Jun,et al.  Soft measurement of wood defects based on LDA feature fusion and compressed sensor images , 2017, Journal of Forestry Research.

[2]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[3]  Supachai Pathumnakul,et al.  An approach based on digital image analysis to estimate the live weights of pigs in farm environments , 2015, Comput. Electron. Agric..

[4]  Sri Harish Reddy Mallidi,et al.  On the Relevance of Auditory-Based Gabor Features for Deep Learning in Automatic Speech Recognition , 2017, ArXiv.

[5]  Asifullah Khan,et al.  Two-phase deep convolutional neural network for reducing class skewness in histopathological images based breast cancer detection , 2017, Comput. Biol. Medicine.

[6]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Ying-Ming Wang,et al.  An adaptive neuro-fuzzy inference system for bridge risk assessment , 2008, Expert Syst. Appl..

[8]  Da-Wen Sun,et al.  Hyperspectral imaging for food quality analysis and control , 2010 .

[9]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[10]  Andrew Gelman,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2006 .

[11]  Michel C. Desmarais,et al.  Performance Comparison of Recent Imputation Methods for Classification Tasks over Binary Data , 2017, Appl. Artif. Intell..

[12]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[13]  Brandon K. Vaughn,et al.  Data analysis using regression and multilevel/hierarchical models, by Gelman, A., & Hill, J. , 2008 .

[14]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[15]  Shuigeng Zhou,et al.  Boosting compound-protein interaction prediction by deep learning , 2015, BIBM.

[16]  Song Bai,et al.  Deep learning representation using autoencoder for 3D shape retrieval , 2014, SPAC.

[17]  Zhe Wang,et al.  Self-regulation in chemical and bio-engineering materials for intelligent systems , 2018, CAAI Trans. Intell. Technol..

[18]  Jian-Da Wu,et al.  Fault gear identification and classification using discrete wavelet transform and adaptive neuro-fuzzy inference , 2009, Expert Syst. Appl..

[19]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[20]  Yong Peng,et al.  Modeling reference evapotranspiration using extreme learning machine and generalized regression neural network only with temperature data , 2017, Comput. Electron. Agric..

[21]  Yudong Zhang,et al.  Fruit classification using computer vision and feedforward neural network , 2014 .

[22]  Piotr Boniecki,et al.  Application of neural image analysis in evaluating the quality of greenhouse tomatoes , 2017 .

[23]  Mohammad Saber Iraji,et al.  Classification Tomatoes on Machine Vision with Fuzzy the Mamdani Inference, Adaptive Neuro Fuzzy Inference System Based (Anfis-Sugeno) , 2011 .

[24]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[25]  Margarita Ruiz-Altisent,et al.  Shape determination of horticultural produce using two-dimensional computer vision – A review , 2012 .

[26]  Nidhi Goel,et al.  Fuzzy classification of pre-harvest tomatoes for ripeness estimation - An approach based on automatic rule learning using decision tree , 2015, Appl. Soft Comput..

[27]  P. Toivonen,et al.  Effects of nutrient solution electrical conductivity on the compositional and sensory characteristics of greenhouse tomato fruit , 2012 .

[28]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[29]  Abhinav Singh,et al.  A machine learning approach to product review disambiguation based on function, form and behavior classification , 2017, Decis. Support Syst..

[30]  Hua Li,et al.  A novel pattern recognition algorithm: Combining ART network with SVM to reconstruct a multi-class classifier , 2009, Comput. Math. Appl..

[31]  Sami Ekici,et al.  An adaptive neuro-fuzzy inference system (ANFIS) model for wire-EDM , 2009, Expert Syst. Appl..

[32]  Keyu Lu,et al.  Efficient deep network for vision-based object detection in robotic applications , 2017, Neurocomputing.

[33]  Hely Tuorila,et al.  Application of a sorting procedure to greenhouse-grown cucumbers and tomatoes , 2010 .

[34]  Abdelouahab Moussaoui,et al.  Deep Learning for Tomato Diseases: Classification and Symptoms Visualization , 2017, Appl. Artif. Intell..

[35]  Irwin R. Donis-González,et al.  Classification of processing asparagus sections using color images , 2016, Comput. Electron. Agric..

[36]  Rongrong Ji,et al.  Sparse auto-encoder based feature learning for human body detection in depth image , 2015, Signal Process..

[37]  Ismail Hakki Boyaci,et al.  Determination of visual quality of tomato paste using computerized inspection system and artificial neural networks , 2011 .

[38]  Sri Harish Reddy Mallidi,et al.  On the relevance of auditory-based Gabor features for deep learning in robust speech recognition , 2017, Comput. Speech Lang..

[39]  David J. Brown,et al.  A survey on computational intelligence approaches for predictive modeling in prostate cancer , 2017, Expert Syst. Appl..

[40]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[41]  Yong Xu,et al.  Face recognition using both visible light image and near-infrared image and a deep network , 2017, CAAI Trans. Intell. Technol..

[42]  De-Shuang Huang,et al.  Improved extreme learning machine for function approximation by encoding a priori information , 2006, Neurocomputing.

[43]  Yong Chen,et al.  Can back-calculated lengths based on otoliths measurements provide reliable estimates of Atlantic halibut (Hippoglossus hippoglossus) growth in the Gulf of Maine (U.S.A.)? , 2017 .

[44]  Jianmin Pan,et al.  ROC-ing along: Evaluation and interpretation of receiver operating characteristic curves. , 2016, Surgery.

[45]  Yan Zhang,et al.  Deep neural network for halftone image classification based on sparse auto-encoder , 2016, Eng. Appl. Artif. Intell..

[46]  Mahmoud Omid,et al.  Analysis of texture-based features for predicting mechanical properties of horticultural products by laser light backscattering imaging , 2013 .

[47]  G. Polder,et al.  Measuring Ripening of Tomatoes Using Imaging Spectrometry , 2010 .

[48]  Mohammad Saber Iraji.  Multi-layer architecture for adaptive fuzzy inference system with a large number of input features , 2017, Cognitive Systems Research.

[49]  Aasima Rafiq,et al.  Artificial Neural Network-Based Image Analysis for Evaluation of Quality Attributes of Agricultural Produce , 2016 .

[50]  Mario Ignacio Chacon Murguia,et al.  Subjective measurement of cosmetic defects using a Computational Intelligence approach , 2010, Eng. Appl. Artif. Intell..

[51]  Moon S. Kim,et al.  Detection of cuticle defects on cherry tomatoes using hyperspectral fluorescence imagery , 2013 .

[52]  Naoshi Kondo,et al.  Use of Machine Vision to Sort Tomato Seedlings for Grafting Robot , 2011 .

[53]  Junhui Jiang,et al.  Heritability of growth traits in the Asian seabass (Lates calcarifer) , 2017 .

[54]  Zhe George Zhang,et al.  Forecasting stock indices with back propagation neural network , 2011, Expert Syst. Appl..

[55]  Robert K. L. Gay,et al.  Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning , 2009, IEEE Transactions on Neural Networks.