3D reconstruction of apple fruits using consumer-grade RGB-depth sensor

Abstract Three-dimensional reconstruction has great potential to improve not only the post-harvest quality control but also the breeding efficiency in horticulture. The depth information of the consumer-grade RGB-depth sensor was unreliable compared to that obtained from industrial sensors. To cope with this disadvantage, the generated point cloud was corrected within a region of interest of the target fruit, which was extracted from the color image of the sensor. Evaluating more than a hundred apple fruits, the root-mean-square error of the volume and the largest diameter were less than 6 cm3 and 1 mm, respectively. Reconstruction of various kinds of fruits and vegetables were demonstrated. The proposed method can be applied to accelerate the quantification of three-dimensional features of agricultural products.

[1]  Koro Kato,et al.  Electrical Density Sorting and Estimation of Soluble Solids Content of Watermelon , 1997 .

[2]  F. J. García-Ramos,et al.  Non-destructive technologies for fruit and vegetable size determination - a review , 2009 .

[3]  Jørgen Kongsro,et al.  Estimation of pig weight using a Microsoft Kinect prototype imaging system , 2014 .

[4]  Junichi Sugiyama,et al.  Near-infrared imaging spectroscopy based on sugar absorption band for melons. , 2002, Journal of agricultural and food chemistry.

[5]  Daniel Moura,et al.  In-field crop row phenotyping from 3D modeling performed using Structure from Motion , 2015, Comput. Electron. Agric..

[6]  Bikram Adhikari,et al.  Identification of pruning branches in tall spindle apple trees for automated pruning , 2014 .

[7]  Shigehiko Hayashi,et al.  Measurement of Growth Information of a Strawberry Plant Using a Natural Interaction Device , 2012 .

[8]  Griffiths G. Atungulu,et al.  Three-Dimensional Geometric Modeling of Processing Tomatoes , 2011 .

[9]  Shigehiko Hayashi,et al.  Growth Measurement of a Community of Strawberries Using Three-Dimensional Sensor , 2015 .

[10]  T. F. Schatzki,et al.  APPLE WATERCORE SORTING SYSTEM USING X-RAY IMAGERY: I. ALGORITHM DEVELOPMENT , 2000 .

[11]  S. Yokoyama,et al.  Three-dimensional shape measurement of strawberries by volume intersection method , 2006 .

[12]  Margarita Ruiz-Altisent,et al.  Review: Sensors for product characterization and quality of specialty crops-A review , 2010 .

[13]  Changying Li,et al.  Size estimation of sweet onions using consumer-grade RGB-depth sensor , 2014 .

[14]  Matthew N. Dailey,et al.  Automatic morphological trait characterization for corn plants via 3D holographic reconstruction , 2014 .

[15]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .