Development of deep learning method for predicting firmness and soluble solid content of postharvest Korla fragrant pear using Vis/NIR hyperspectral reflectance imaging

Abstract The objective of this research was to develop a deep learning method which consisted of stacked auto-encoders (SAE) and fully-connected neural network (FNN) for predicting firmness and soluble solid content (SSC) of postharvest Korla fragrant pear (Pyrus brestschneideri Rehd). Firstly, deep spectral features in visible and near-infrared (380–1030 nm) hyperspectral reflectance image data of pear were extracted by SAE, and then these features were used as input data to predict firmness and SSC by FNN. The SAE-FNN model achieved reasonable prediction performance with R2P = 0.890, RMSEP = 1.81 N and RPDP = 3.05 for firmness, and R2P = 0.921, RMSEP = 0.22% and RPDP = 3.68 for SSC. This research demonstrated that deep learning method coupled with hyperspectral imaging technique can be used for rapid and nondestructive detecting firmness and SSC in Korla fragrant pear, which would be useful for postharvest fruit quality inspections.

[1]  G. Teixeira,et al.  Determination of ‘Palmer’ mango maturity indices using portable near infrared (VIS-NIR) spectrometer , 2017 .

[2]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[3]  Renfu Lu,et al.  Integrated spectral and image analysis of hyperspectral scattering data for prediction of apple fruit firmness and soluble solids content , 2011 .

[4]  M. Hertog,et al.  Humidity and temperature effects on invasive and non-invasive firmness measures , 2004 .

[5]  Da-Wen Sun,et al.  Recent Advances in Wavelength Selection Techniques for Hyperspectral Image Processing in the Food Industry , 2014, Food and Bioprocess Technology.

[6]  Yves Roggo,et al.  Infrared hyperspectral imaging for qualitative analysis of pharmaceutical solid forms , 2005 .

[7]  A. Adedeji,et al.  Hyperspectral imaging for detection of codling moth infestation in GoldRush apples , 2017 .

[8]  L. Lin,et al.  Effect of 1-Methylcyclopropene on Fruit Quality and Physiological Disorders in Yali Pear (Pyrus bretschneideri Rehd.) During Storage , 2007 .

[9]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[10]  R. Lu,et al.  Development of a multichannel hyperspectral imaging probe for property and quality assessment of horticultural products , 2017 .

[11]  Giorgia Foca,et al.  Fast exploration and classification of large hyperspectral image datasets for early bruise detection on apples , 2015 .

[12]  Lixia Xiao,et al.  Changes in the volatile compounds and chemical and physical properties of Yali pear (Pyrus bertschneideri Reld) during storage , 2006 .

[13]  Mantong Zhao,et al.  Pears characteristics (soluble solids content and firmness prediction, varieties) testing methods based on visible-near infrared hyperspectral imaging , 2016 .

[14]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[15]  Sebastián Dormido-Canto,et al.  Automatic feature extraction in large fusion databases by using deep learning approach , 2016 .

[16]  R. V. Rossel,et al.  Determining the composition of mineral-organic mixes using UV–vis–NIR diffuse reflectance spectroscopy , 2006 .

[17]  Yankun Peng,et al.  Hyperspectral Scattering for Assessing Peach Fruit Firmness , 2004 .

[18]  Xinjie Yu,et al.  Nondestructive Freshness Discriminating of Shrimp Using Visible/Near-Infrared Hyperspectral Imaging Technique and Deep Learning Algorithm , 2018, Food Analytical Methods.

[19]  Giovanni Montana,et al.  Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker , 2016, NeuroImage.

[20]  Rung-Ching Chen,et al.  A novel passenger flow prediction model using deep learning methods , 2017 .

[21]  Ingo Truppel,et al.  An approach to non-destructive apple fruit chlorophyll determination , 2002 .

[22]  Antonietta Baiano,et al.  Application of hyperspectral imaging for prediction of physico-chemical and sensory characteristics of table grapes , 2012 .

[23]  Shuxiang Fan,et al.  Detection of blueberry internal bruising over time using NIR hyperspectral reflectance imaging with optimum wavelengths , 2017 .

[24]  Renfu Lu,et al.  Prediction of firmness and soluble solids content of blueberries using hyperspectral reflectance imaging , 2013 .

[25]  S. Wold,et al.  PLS-regression: a basic tool of chemometrics , 2001 .

[26]  D. J. Reid,et al.  Assessment of internal quality attributes of mandarin fruit. 1. NIR calibration model development , 2005 .

[27]  Dayang Liu,et al.  Determination of soluble solids content and firmness of pears during ripening by using dielectric spectroscopy , 2015, Comput. Electron. Agric..

[28]  Yande Liu,et al.  Nondestructive determination of pear internal quality indices by visible and near-infrared spectrometry , 2008 .

[29]  P. Martinsen,et al.  Measuring soluble solids distribution in kiwifruit using near-infrared imaging spectroscopy , 1998 .

[30]  Wang Zhihua,et al.  Effect of Modified Atmosphere Packaging on Postharvest Physiology and Quality of 'Korla Xiangli' Pears During Storage , 2016 .

[31]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[32]  Baohua Zhang,et al.  Prediction of soluble solids content of apple using the combination of spectra and textural features of hyperspectral reflectance imaging data , 2016 .

[33]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[34]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[35]  Fei Zhang,et al.  Cloning and expression analysis of an MYB gene associated with calyx persistence in Korla fragrant pear , 2014, Plant Cell Reports.

[36]  Huirong Xu,et al.  Effect of fruit moving speed on predicting soluble solids content of ‘Cuiguan’ pears (Pomaceae pyrifolia Nakai cv. Cuiguan) using PLS and LS-SVM regression , 2009 .

[37]  Li Huang,et al.  Accelerated Monte Carlo simulations with restricted Boltzmann machines , 2016, 1610.02746.

[38]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[40]  Song Bai,et al.  Deep learning representation using autoencoder for 3D shape retrieval , 2014, SPAC.

[41]  E Biganzoli,et al.  Feed forward neural networks for the analysis of censored survival data: a partial logistic regression approach. , 1998, Statistics in medicine.

[42]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[43]  Jun Wang,et al.  Development of multi-cultivar models for predicting the soluble solid content and firmness of European pear (Pyrus communis L.) using portable vis–NIR spectroscopy , 2017 .

[44]  Asifullah Khan,et al.  Wind power prediction using deep neural network based meta regression and transfer learning , 2017, Appl. Soft Comput..

[45]  Xing Chen,et al.  Stacked Denoise Autoencoder Based Feature Extraction and Classification for Hyperspectral Images , 2016, J. Sensors.

[46]  Yi-Chao Yang,et al.  Recent Advances in the Application of Hyperspectral Imaging for Evaluating Fruit Quality , 2015, Food Analytical Methods.