Original papers: Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry

This paper describes a computer vision based model for object detection that can serve as a preliminary step in fruit prognosis, which involves the estimation of the number, diameter and yield of apple fruits. In order to overcome the recognition unreliability in uncontrolled environments caused by uneven illumination conditions, partly occluded surfaces, and similar background features, we rely on a combination of the object's colour, texture and 3D shape properties. In our research, we apply colour segmentation to multiple scene snapshots to separate potential regions from the background and verify them first with texture analysis and second by reconstructing them to 3D space. By analysing all three distinct features (colour, texture and 3D shape) of possible areas, we can safely conclude if they represent fruits we are looking for. Once we detect and verify all areas representing fruits, we can measure their size and model estimated fruit yield.

[1]  J.L. Pons,et al.  A machine vision system using a laser radar applied to robotic fruit harvesting , 1999, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS'99).

[2]  G. E. Miles,et al.  Locating melons for robotic harvesting using structured light , 1992 .

[3]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[4]  Françoise Peyrin,et al.  The use of a two-dimensional Hilbert transform for Wigner analysis of 2-dimensional real signals , 1990 .

[5]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration , 2004 .

[6]  E. J. van Henten,et al.  Field Test of an Autonomous Cucumber Picking Robot , 2003 .

[7]  E. Wigner.  On the quantum correction for thermodynamic equilibrium , 1932 .

[8]  Jun Zhao,et al.  On-tree fruit recognition using texture properties and color data , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  J. Rakun.  The computer-aided detection of inferior printing quality and errors , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[10]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[11]  Richard G. Baraniuk.  Nonlinear Wigner-Ville spectrum estimation using wavelet soft-thresholding , 1995, Defense, Security, and Sensing.

[12]  D. Stajnko,et al.  Modelling apple fruit yield using image analysis for fruit colour, shape and texture. , 2009 .

[13]  Jean Ponce,et al.  Detecting Abandoned Objects With a Moving Camera , 2010, IEEE Transactions on Image Processing.

[14]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[15]  Fernando López-García,et al.  Automatic detection of skin defects in citrus fruits using a multivariate image analysis approach , 2010 .

[16]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[17]  Michael J. Delwiche,et al.  Computer Vision to Locate Fruit on a Tree , 1985 .

[18]  G. Camps-Valls,et al.  Hyperspectral system for early detection of rottenness caused by Penicillium digitatum in mandarins , 2008 .

[19]  Gabriel Cristóbal,et al.  Motion estimation by the pseudo-Wigner Ville distribution and the Hough Transform , 2006, 2006 14th European Signal Processing Conference.

[20]  Lokenath Debnath,et al.  The Wigner–Ville Distribution and Time–Frequency Signal Analysis , 2002 .

[21]  Hany Farid,et al.  Medical image registration with partial data , 2006, Medical Image Anal..

[22]  Martial Hebert,et al.  Provably-convergent iterative methods for projective structure from motion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  J. Rakun,et al.  Optimisation of Image Registration for Print Quality Control , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[24]  Tateshi Fujiura,et al.  Cherry-harvesting robot , 2008 .