An Automatic Non-Destructive Method for the Classification of the Ripeness Stage of Red Delicious Apples in Orchards Using Aerial Video

The estimation of the ripening state in orchards helps improve post-harvest processes. Picking fruits based on their stage of maturity can reduce the cost of storage and increase market outcomes. Moreover, aerial images and the estimated ripeness can be used as indicators for detecting water stress and determining the water applied during irrigation. Additionally, they can also be related to the crop coefficient (Kc) of seasonal water needs. The purpose of this research is to develop a new computer vision algorithm to detect the existing fruits in aerial images of an apple cultivar (of Red Delicious variety) and estimate their ripeness stage among four possible classes: unripe, half-ripe, ripe, and overripe. The proposed method is based on a combination of the most effective color features and a classifier based on artificial neural networks optimized with genetic algorithms. The obtained results indicate an average classification accuracy of 97.88%, over a dataset of 8390 images and 27,687 apples, and values of the area under the ROC (receiver operating characteristic) curve near or above 0.99 for all classes. We believe this is a remarkable performance that allows a proper non-intrusive estimation of ripening that will help to improve harvesting strategies.

[1]  K. Madhava Krishna,et al.  Plantation monitoring and yield estimation using autonomous quadcopter for precision agriculture , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Sai Zou,et al.  Optimized algorithm of sensor node deployment for intelligent agricultural monitoring , 2016, Comput. Electron. Agric..

[3]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[4]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[5]  Ginés García-Mateos,et al.  A fast and accurate expert system for weed identification in potato crops using metaheuristic algorithms , 2018, Comput. Ind..

[6]  M. F. Kocher,et al.  Textural imaging and discriminant analysis for distinguishing weeds for spot spraying , 1998 .

[7]  Liping Di,et al.  Automatic Identification of Center Pivot Irrigation Systems from Landsat Images Using Convolutional Neural Networks , 2018, Agriculture.

[8]  Ning Wang,et al.  Studies on banana fruit quality and maturity stages using hyperspectral imaging , 2012 .

[9]  Raúl Aquino-Santos,et al.  Developing a New Wireless Sensor Network Platform and Its Application in Precision Agriculture , 2011, Sensors.

[10]  Gregoriy Kaplan,et al.  Estimating cotton water consumption using a time series of Sentinel-2 imagery , 2018 .

[11]  J. M. González-Esquiva,et al.  Optimal color space selection method for plant/soil segmentation in agriculture , 2016, Comput. Electron. Agric..

[12]  Ross A Frick,et al.  Classification of images of wheat, ryegrass and brome grass species at early growth stages using principal component analysis , 2011, Plant Methods.

[13]  Yuzhen Lu,et al.  Innovative Hyperspectral Imaging-Based Techniques for Quality Evaluation of Fruits and Vegetables: A Review , 2017 .

[14]  Ramesh Raskar,et al.  Ultra-portable, wireless smartphone spectrometer for rapid, non-destructive testing of fruit ripeness , 2016, Scientific Reports.

[15]  Long He,et al.  Sensing and Automation in Pruning of Apple Trees: A Review , 2018, Agronomy.

[16]  T. Kataoka,et al.  Crop growth estimation system using machine vision , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[17]  George E. Meyer,et al.  Plant species identification, size, and enumeration using machine vision techniques on near-binary images , 1993, Other Conferences.

[18]  Bo Li,et al.  Advances in Non-Destructive Early Assessment of Fruit Ripeness towards Defining Optimal Time of Harvest and Yield Prediction—A Review , 2017, Plants.

[19]  Asutosh Mohapatra,et al.  Grading of ripening stages of red banana using dielectric properties changes and image processing approach , 2017, Comput. Electron. Agric..

[20]  Chung-Liang Chang,et al.  Smart Agricultural Machine with a Computer Vision-Based Weeding and Variable-Rate Irrigation Scheme , 2018, Robotics.

[21]  Jose A. Jiménez-Berni,et al.  Pheno-Copter: A Low-Altitude, Autonomous Remote-Sensing Robotic Helicopter for High-Throughput Field-Based Phenotyping , 2014 .

[22]  Marcus Nagle,et al.  Prediction mapping of physicochemical properties in mango by hyperspectral imaging , 2017 .

[23]  Jorge Chanona-Pérez,et al.  Evaluation of the ripening stages of apple (Golden Delicious) by means of computer vision system , 2017 .

[24]  Manuela Zude,et al.  Spectral shift as advanced index for fruit chlorophyll breakdown , 2014, Food and Bioprocess Technology.

[25]  José Manuel Amigo,et al.  Ripeness monitoring of two cultivars of nectarine using VIS-NIR hyperspectral reflectance imaging , 2017 .

[26]  S. Raine,et al.  Soil–water and solute movement under precision irrigation: knowledge gaps for managing sustainable root zones , 2007, Irrigation Science.

[27]  J. M. González-Esquiva,et al.  A new model for water balance estimation on lettuce crops using effective diameter obtained with image analysis , 2017 .

[28]  J. M. Molina-Martínez,et al.  Segmentation of Apples in Aerial Images under Sixteen Different Lighting Conditions Using Color and Texture for Optimal Irrigation , 2018, Water.

[29]  Juan Liao,et al.  Segmentation of Rice Seedlings Using the YCrCb Color Space and an Improved Otsu Method , 2018, Agronomy.

[30]  Umezuruike Linus Opara,et al.  Non-destructive prediction of internal and external quality attributes of fruit with thick rind: A review , 2018 .

[31]  Pietro Rocculi,et al.  Non-destructive assessment of kiwifruit physico-chemical parameters to optimise the osmotic dehydration process: A study on FT-NIR spectroscopy , 2016 .

[32]  A. H. Gómez,et al.  Evaluation of tomato maturity by electronic nose , 2006 .

[33]  H. Nieto,et al.  Crop water stress maps for an entire growing season from visible and thermal UAV imagery , 2016 .

[34]  João Valente,et al.  A Comprehensive Study of the Potential Application of Flying Ethylene-Sensitive Sensors for Ripeness Detection in Apple Orchards , 2019, Sensors.

[35]  Carlos Eugenio Oliveros,et al.  Automatic fruit count on coffee branches using computer vision , 2017, Comput. Electron. Agric..

[36]  Lav R. Khot,et al.  Low altitude remote sensing technologies for crop stress monitoring: a case study on spatial and temporal monitoring of irrigated pinto bean , 2018, Precision Agriculture.