Hyperspectral imaging and machine learning for monitoring produce ripeness

Hyperspectral imaging is a powerful remote sensing tool capable of capturing rich spectral and spatial information. Although the origins of hyperspectral imaging are in terrestrial remote sensing, new applications are emerging rapidly. Owing to its non-destructive nature, hyperspectral imaging has become a useful tool for monitoring produce ripeness. This paper describes the process that uses a visible near-infrared (VNIR) hyperspectral imager from Resonon, Inc., coupled with machine learning algorithms to assess the ripeness of various pieces of produce. The images were converted to reflectance across a spectral range of 387.12 nm to 1023.5 nm, with a spectral resolution of 2.12 nm. A convolutional neural network was used to perform age classification for potatoes, bananas, and green peppers. Additionally, a genetic algorithm was used to determine the wavelengths carrying the most useful information for age classification. Experiments were run using RGB images, full spectrum hyperspectral images, and the genetic algorithm feature selection method. Results showed that the genetic algorithm-based feature selection method outperforms RGB images for all tested produce, outperforms hyperspectral imagery for bananas, and matches hyperspectral imagery performance for green peppers. This feature selection method is being used to develop a low-cost multi-spectral imager for use in monitoring produce in grocery stores.

[1]  Aboul Ella Hassanien,et al.  Using machine learning techniques for evaluating tomato ripeness , 2015, Expert Syst. Appl..

[2]  John W. Sheppard,et al.  Efficient Convolutional Neural Networks for Multi-Spectral Image Classification , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[3]  Gerrit Polder,et al.  Tomato sorting using independent component analysis on spectral images , 2003, Real Time Imaging.

[4]  J. Bower,et al.  Avocado Fruit Development and Ripening Physiology , 2011 .

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  K. Venkat The Climate Change and Economic Impacts of Food Waste in the United States , 2011 .

[7]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[8]  J Scott Tyo,et al.  Review of passive imaging polarimetry for remote sensing applications. , 2006, Applied optics.

[9]  Colin Webb,et al.  Analysing global food waste problem: pinpointing the facts and estimating the energy content , 2013 .

[10]  Ramesh Raskar,et al.  Machine learning approaches for large scale classification of produce , 2018, Scientific Reports.

[11]  A. Peirs,et al.  Prediction of the optimal picking date of different apple cultivars by means of VIS/NIR-spectroscopy , 2001 .

[12]  U. Sonesson,et al.  Global food losses and food waste: extent, causes and prevention , 2011 .

[13]  Wilson Castro,et al.  Classification of Cape Gooseberry Fruit According to its Level of Ripeness Using Machine Learning Techniques and Different Color Spaces , 2019, IEEE Access.

[14]  Gerrit Polder,et al.  Hyperspectral image analysis for measuring ripeness of tomatoes. , 2000 .

[15]  Joseph A. Shaw,et al.  Discrimination of herbicide-resistant kochia with hyperspectral imaging , 2018 .

[16]  Aboul Ella Hassanien,et al.  Bell pepper ripeness classification based on support vector machine , 2014, 2014 International Conference on Engineering and Technology (ICET).

[17]  J. Buzby,et al.  The Estimated Amount, Value, and Calories of Postharvest Food Losses at the Retail and Consumer Levels in the United States , 2014 .

[18]  P. Luning,et al.  Gas chromatography, mass spectrometry, and sniffing port analyses of volatile compounds of fresh bell peppers (Capsicum annuum) at different ripening stages. , 1994 .

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  J. Abbott Quality measurement of fruits and vegetables , 1999 .

[21]  José Blasco,et al.  Detecting rottenness caused by Penicillium genus fungi in citrus fruits using machine learning techniques , 2012, Expert Syst. Appl..

[22]  R. Tharanathan,et al.  Fruit Ripening Phenomena–An Overview , 2007, Critical reviews in food science and nutrition.

[23]  M. Li,et al.  Optical chlorophyll sensing system for banana ripening , 1997 .

[24]  Rashmi Pandey,et al.  Image Processing and Machine Learning for Automated Fruit Grading System: A Technical Review , 2013 .

[25]  Fernando Alonso-Fernandez,et al.  Fruit and Vegetable Identification Using Machine Learning for Retail Applications , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[26]  R. Monéger,et al.  Pigment evolution in Lycopersicon esculentum fruits during growth and ripening , 1975 .

[27]  Kevin D. Hall,et al.  The Progressive Increase of Food Waste in America and Its Environmental Impact , 2009, PloS one.

[28]  Y. R. Chen,et al.  HYPERSPECTRAL REFLECTANCE AND FLUORESCENCE IMAGING SYSTEM FOR FOOD QUALITY AND SAFETY , 2001 .

[29]  Joseph A. Shaw,et al.  Hyperspectral imaging and neural networks to classify herbicide-resistant weeds , 2019, Journal of Applied Remote Sensing.

[30]  J. Gómez-Sanchís,et al.  Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[31]  Jorge Chanona-Pérez,et al.  Early detection of mechanical damage in mango using NIR hyperspectral images and machine learning , 2014 .

[32]  Larry K. Hiller,et al.  Color indices for the assessment of chlorophyll development and greening of fresh market potatoes , 2006 .