Definition of Linear Color Models in the RGB Vector Color Space to Detect Red Peaches in Orchard Images Taken under Natural Illumination

This work proposes the detection of red peaches in orchard images based on the definition of different linear color models in the RGB vector color space. The classification and segmentation of the pixels of the image is then performed by comparing the color distance from each pixel to the different previously defined linear color models. The methodology proposed has been tested with images obtained in a real orchard under natural light. The peach variety in the orchard was the paraguayo (Prunus persica var. platycarpa) peach with red skin. The segmentation results showed that the area of the red peaches in the images was detected with an average error of 11.6%; 19.7% in the case of bright illumination; 8.2% in the case of low illumination; 8.6% for occlusion up to 33%; 12.2% in the case of occlusion between 34 and 66%; and 23% for occlusion above 66%. Finally, a methodology was proposed to estimate the diameter of the fruits based on an ellipsoidal fitting. A first diameter was obtained by using all the contour pixels and a second diameter was obtained by rejecting some pixels of the contour. This approach enables a rough estimate of the fruit occlusion percentage range by comparing the two diameter estimates.

[1]  Filiberto Pla,et al.  Feature extraction of spherical objects in image analysis: an application to robotic citrus harvesting , 1993 .

[2]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .

[3]  Tateshi Fujiura,et al.  Cherry-harvesting robot , 2008 .

[4]  Antonio Bandera,et al.  Visual Odometry Based on Structural Matching of Local Invariant Features Using Stereo Camera Sensor , 2011, Sensors.

[5]  M. J. Delwiche,et al.  PEACH DEFECT DETECTION WITH MACHINE VISION , 1991 .

[6]  Mao-Hsiung Chiang,et al.  Development of a 3D Parallel Mechanism Robot Arm with Three Vertical-Axial Pneumatic Actuators Combined with a Stereo Vision System , 2011, Sensors.

[7]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[8]  A. Mitome,et al.  A recognition method of restricted hand shapes in still image and moving image as a man-machine interface , 2008, 2008 Conference on Human System Interactions.

[9]  Raphael Linker,et al.  Determination of the number of green apples in RGB images recorded in orchards , 2012 .

[10]  V. Alchanatis,et al.  Review: Sensing technologies for precision specialty crop production , 2010 .

[11]  J. M. Aguilera,et al.  Computer vision and food quality , 2005 .

[12]  Javier Díaz,et al.  Vector Disparity Sensor with Vergence Control for Active Vision Systems , 2012, Sensors.

[13]  Victor Alchanatis,et al.  Improving fruit detection for robotic fruit harvesting. , 2009 .

[14]  J. Napoles,et al.  Realization of a flexible platform for fruit inspection and classification applications with emphasis in rapid prototyping and development , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[15]  Jose L Pons,et al.  A SURVEY OF COMPUTER VISION METHODS FOR LOCATING FRUIT ON TREES , 2000 .

[16]  Vijayan K. Asari,et al.  Recurrent neural network as a linear attractor for pattern association , 2006, IEEE Transactions on Neural Networks.

[17]  José Blasco,et al.  Machine Vision System for Automatic Quality Grading of Fruit , 2003 .

[18]  Y. Liu,et al.  DEVELOPMENT OF A MACHINE VISION ALGORITHM FOR RECOGNITION OF PEACH FRUIT IN A NATURAL SCENE , 2011 .

[19]  Eduard Gregorio-Lopez,et al.  Characterisation of the LMS200 Laser Beam under the Influence of Blockage Surfaces. Influence on 3D Scanning of Tree Orchards , 2011, Sensors.

[20]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[21]  Filiberto Pla,et al.  Colour segmentation based on a light reflection model to locate citrus fruits for robotic harvesting , 1993 .

[22]  Giorgio Grasso,et al.  Localization of spherical fruits for robotic harvesting , 2001, Machine Vision and Applications.

[23]  J. Flusser,et al.  Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[24]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[25]  Yud-Ren Chen,et al.  Machine vision technology for agricultural applications , 2002 .

[26]  Manuel Mazo,et al.  Multi-Camera Sensor System for 3D Segmentation and Localization of Multiple Mobile Robots , 2010, Sensors.

[27]  M. J. Delwiche,et al.  Spectral analysis of peach surface defects. , 1990 .

[28]  J. Marchant,et al.  Segmentation of row crop plants from weeds using colour and morphology , 2003 .

[29]  José Blasco,et al.  Multispectral inspection of citrus in real-time using machine vision and digital signal processors , 2002 .

[30]  D. Stajnko,et al.  Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging , 2004 .

[31]  Margarita Ruiz-Altisent,et al.  Review: Sensors for product characterization and quality of specialty crops-A review , 2010 .

[32]  KimKyungnam,et al.  Real-time foreground-background segmentation using codebook model , 2005 .

[33]  Alex Pentland,et al.  Stochasticks: augmenting the billiards experience with probabilistic vision and wearable computers , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[34]  V. Alchanatis,et al.  Low and high-level visual feature-based apple detection from multi-modal images , 2010, Precision Agriculture.

[35]  Alexandre Escolà,et al.  Innovative LIDAR 3D Dynamic Measurement System to Estimate Fruit-Tree Leaf Area , 2011, Sensors.

[36]  Brian L. Steward,et al.  Reduced-Dimension Clustering for Vegetation Segmentation , 2004 .

[37]  Heping Zhu,et al.  Robust Crop and Weed Segmentation under Uncontrolled Outdoor Illumination , 2011, Sensors.

[38]  José Luis Pons Rovira,et al.  Automatic fruit recognition: a survey and new results using Range/Attenuation images , 1999, Pattern Recognit..

[39]  Zhao Dean,et al.  System Design and Control of an Apple Harvesting Robot , 2020, ArXiv.

[40]  John A. Marchant,et al.  Physics-based colour image segmentation for scenes containing vegetation and soil , 2001, Image Vis. Comput..

[41]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[42]  Bernard Panneton,et al.  Colour representation methods for segmentation of vegetation in photographs , 2009 .

[43]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[44]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[45]  J. Rosell,et al.  Sensitivity of tree volume measurement to trajectory errors from a terrestrial LIDAR scanner. , 2010 .