Potato Quality Grading Based on Depth Imaging and Convolutional Neural Network

As a cost-effective and nondestructive detection method, the machine vision technology has been widely applied in the detection of potato defects. Recently, the depth camera which supports range sensing has been used for potato surface defect detection, such as bumps and hollows. In this study, we developed a potato automatic grading system that uses a depth imaging system as a data collector and applies a machine learning system for potato quality grading. The depth imaging system collects 3D potato surface thickness distribution data and stores depth images for the training and validation of the machine learning system. The machine learning system, which is composed of a softmax regression model and a convolutional neural network model, can grade a potato tube into six different quality levels based on tube appearance and size. The experimental results indicate that the softmax regression model has a high accuracy in sample size detection, with a 94.4% success rate, but a low success rate in appearance classification (only 14.5% for the lowest group). The convolutional neural network model, however, achieved a high success rate not only in size classification, at 94.5%, but also in appearance classification, at 91.6%, and the overall quality grading accuracy was 86.6%. The quality grading based on the depth imaging technology shows its potential and advantages in nondestructive postharvesting research, especially for 3D surface shape-related fields.

[1]  J. Engel Polytomous logistic regression , 1988 .

[2]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[3]  Hong Sun,et al.  Potato quality grading based on machine vision and 3D shape analysis , 2018, Comput. Electron. Agric..

[4]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[5]  Cheickna Sylla,et al.  Experimental investigation of human and machine-vision arrangements in inspection tasks , 2002 .

[6]  Hiroshi Okamoto,et al.  Discrimination between potato tubers and clods by detecting the significant wavebands , 2008 .

[7]  Takashi Kataoka,et al.  An image processing algorithm for detecting in-line potato tubers without singulation , 2010 .

[8]  Yandra Arkeman,et al.  Satellite image processing for precision agriculture and agroindustry using convolutional neural network and genetic algorithm , 2017, IOP Conference Series: Earth and Environmental Science.

[9]  Noel E. O'Connor,et al.  Automatic Detection of Knee Joints and Quantification of Knee Osteoarthritis Severity Using Convolutional Neural Networks , 2017, MLDM.

[10]  Ye Zhang,et al.  APPLICATION OF CONVOLUTIONAL NEURAL NETWORK IN CLASSIFICATION OF HIGH RESOLUTION AGRICULTURAL REMOTE SENSING IMAGES , 2017 .

[11]  Hermes José Loschi,et al.  A Survey of Potatoes Image Segmentation Based on Machine Vision , 2019 .

[12]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[13]  Toshiaki Fujii,et al.  View Generation with 3D Warping Using Depth Information for FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[14]  Hong Sun,et al.  Potato feature prediction based on machine vision and 3D model rebuilding , 2017, Comput. Electron. Agric..

[15]  Baining Guo,et al.  Kinect Identity: Technology and Experience , 2011, Computer.

[16]  Daniel E. Guyer,et al.  Rapid and/or nondestructive quality evaluation methods for potatoes: A review , 2015, Comput. Electron. Agric..

[17]  José Blasco,et al.  In-line sorting of irregular potatoes by using automated computer-based machine vision system , 2012 .

[18]  M RadyAhmed,et al.  Rapid and/or nondestructive quality evaluation methods for potatoes , 2015 .

[19]  Vikram Chalana,et al.  PC‐based machine vision system for real‐time computer‐aided potato inspection , 1998 .

[20]  Navid Razmjooy,et al.  Computer Vision-Based Potato Defect Detection using Neural Networks and Support Vector Machine , 2013, Int. J. Robotics Autom..

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[22]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[23]  Field Cady,et al.  Machine Learning Classification , 2017 .

[24]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[25]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[26]  Matthew O'Donnell,et al.  Ultrasound detection using polymer microring optical resonator , 2004 .

[27]  Navid Razmjooy,et al.  ROBUST POTATO COLOR IMAGE SEGMENTATION USING ADAPTIVE FUZZY INFERENCE SYSTEM , 2014 .

[28]  Grzegorz Cielniak,et al.  Visual detection of blemishes in potatoes using minimalist boosted classifiers , 2010 .