Assessing produce freshness using hyperspectral imaging and machine learning

Abstract. A method of monitoring produce freshness with hyperspectral imaging and machine learning is described as a way to reduce food waste in grocery stores. The method relies on hyperspectral reflectance images in the visible–near-infrared spectral range from 387.12 to 1023.5 nm with a 2.12-nm spectral resolution. The images were recorded in a laboratory with the imager viewing produce samples illuminated by broadband halogen lights, but we also recorded and discussed the implications of the illumination spectrum of lights found in a variety of grocery stores. A convolutional neural network was used to perform freshness classification for potatoes, bananas, and green peppers. Additionally, a genetic algorithm (GA) was used to determine the wavelengths carrying the most useful information for age classification, with an eye toward a future multispectral imager. Hyperspectral images were processed to explore the use of RGB images, GA-selected multispectral images, and full-spectrum hyperspectral images. The GA-based feature selection method outperformed RGB images for all tested produce, outperformed hyperspectral imagery for bananas, and matched hyperspectral imagery performance for green peppers. This feature selection method is being used to develop a low-cost multispectral imager for use in monitoring produce in grocery stores.

[1]  Fernando Alonso-Fernandez,et al.  Fruit and Vegetable Identification Using Machine Learning for Retail Applications , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[2]  Aboul Ella Hassanien,et al.  Using machine learning techniques for evaluating tomato ripeness , 2015, Expert Syst. Appl..

[3]  J. Gómez-Sanchís,et al.  Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[4]  Aboul Ella Hassanien,et al.  Bell pepper ripeness classification based on support vector machine , 2014, 2014 International Conference on Engineering and Technology (ICET).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Gerrit Polder,et al.  Hyperspectral image analysis for measuring ripeness of tomatoes. , 2000 .

[7]  José Blasco,et al.  Detecting rottenness caused by Penicillium genus fungi in citrus fruits using machine learning techniques , 2012, Expert Syst. Appl..

[8]  Joseph A. Shaw,et al.  Hyperspectral imaging and neural networks to classify herbicide-resistant weeds , 2019, Journal of Applied Remote Sensing.

[9]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[10]  John W. Sheppard,et al.  Hyperspectral imaging and machine learning for monitoring produce ripeness , 2020, Defense + Commercial Sensing.

[11]  John W. Sheppard,et al.  Efficient Convolutional Neural Networks for Multi-Spectral Image Classification , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[12]  M. Li,et al.  Optical chlorophyll sensing system for banana ripening , 1997 .

[13]  K. Venkat The Climate Change and Economic Impacts of Food Waste in the United States , 2011 .

[14]  J. Buzby,et al.  The Estimated Amount, Value, and Calories of Postharvest Food Losses at the Retail and Consumer Levels in the United States , 2014 .

[15]  J. Bower,et al.  Avocado Fruit Development and Ripening Physiology , 2011 .

[16]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[17]  U. Sonesson,et al.  Global food losses and food waste: extent, causes and prevention , 2011 .

[18]  J. Abbott Quality measurement of fruits and vegetables , 1999 .

[19]  Larry K. Hiller,et al.  Color indices for the assessment of chlorophyll development and greening of fresh market potatoes , 2006 .

[20]  Kevin D. Hall,et al.  The Progressive Increase of Food Waste in America and Its Environmental Impact , 2009, PloS one.

[21]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[22]  Michael T. Eismann Natural Synergy of Conferences and Journals , 2014 .

[23]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[24]  Joseph A. Shaw,et al.  Discrimination of herbicide-resistant kochia with hyperspectral imaging , 2018 .

[25]  Forrest N. Iandola,et al.  Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale , 2016, ArXiv.

[26]  Gerrit Polder,et al.  Tomato sorting using independent component analysis on spectral images , 2003, Real Time Imaging.

[27]  Wilson Castro,et al.  Classification of Cape Gooseberry Fruit According to its Level of Ripeness Using Machine Learning Techniques and Different Color Spaces , 2019, IEEE Access.

[28]  Colin Webb,et al.  Analysing global food waste problem: pinpointing the facts and estimating the energy content , 2013 .

[29]  Joseph A. Shaw,et al.  Measuring the polarization response of a VNIR hyperspectral imager , 2020, Defense + Commercial Sensing.

[30]  P. Luning,et al.  Gas chromatography, mass spectrometry, and sniffing port analyses of volatile compounds of fresh bell peppers (Capsicum annuum) at different ripening stages. , 1994 .

[31]  J Scott Tyo,et al.  Review of passive imaging polarimetry for remote sensing applications. , 2006, Applied optics.

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  V. Vishwakarma,et al.  Identification of Artificially Ripened Fruits Using Machine Learning , 2019, SSRN Electronic Journal.

[34]  A. Peirs,et al.  Prediction of the optimal picking date of different apple cultivars by means of VIS/NIR-spectroscopy , 2001 .

[35]  Rashmi Pandey,et al.  Image Processing and Machine Learning for Automated Fruit Grading System: A Technical Review , 2013 .

[36]  Y. R. Chen,et al.  HYPERSPECTRAL REFLECTANCE AND FLUORESCENCE IMAGING SYSTEM FOR FOOD QUALITY AND SAFETY , 2001 .

[37]  R. Monéger,et al.  Pigment evolution in Lycopersicon esculentum fruits during growth and ripening , 1975 .

[38]  R. Tharanathan,et al.  Fruit Ripening Phenomena–An Overview , 2007, Critical reviews in food science and nutrition.

[39]  Jorge Chanona-Pérez,et al.  Early detection of mechanical damage in mango using NIR hyperspectral images and machine learning , 2014 .

[40]  Ramesh Raskar,et al.  Machine learning approaches for large scale classification of produce , 2018, Scientific Reports.