Evaluating Geometric Measurement Accuracy Based on 3D Reconstruction of Automated Imagery in a Greenhouse

Geometric dimensions of plants are significant parameters for showing plant dynamic responses to environmental variations. An image-based high-throughput phenotyping platform was developed to automatically measure geometric dimensions of plants in a greenhouse. The goal of this paper was to evaluate the accuracy in geometric measurement using the Structure from Motion (SfM) method from images acquired using the automated image-based platform. Images of nine artificial objects of different shapes were taken under 17 combinations of three different overlaps in x and y directions, respectively, and two different spatial resolutions (SRs) with three replicates. Dimensions in x, y and z of these objects were measured from 3D models reconstructed using the SfM method to evaluate the geometric accuracy. A metric power of unit (POU) was proposed to combine the effects of image overlap and SR. Results showed that measurement error of dimension in z is the least affected by overlap and SR among the three dimensions and measurement error of dimensions in x and y increased following a power function with the decrease of POU (R2 = 0.78 and 0.88 for x and y respectively). POUs from 150 to 300 are a preferred range to obtain reasonable accuracy and efficiency for the developed image-based high-throughput phenotyping system. As a study case, the developed system was used to measure the height of 44 plants using an optimal POU in greenhouse environment. The results showed a good agreement (R2 = 92% and Root Mean Square Error = 9.4 mm) between the manual and automated method.

[1]  Filiberto Chiabrando,et al.  UAV and RPV systems for photogrammetric surveys in archaelogical areas : two tests in the Piedmont region (Italy) , 2011 .

[2]  Eija Honkavaara,et al.  Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera , 2012, Sensors.

[3]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[4]  S. Robson,et al.  Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application , 2012 .

[5]  Atsushi Shimada,et al.  An Easy-to-Setup 3D Phenotyping Platform for KOMATSUNA Dataset , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[6]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Matthew N. Dailey,et al.  Automatic morphological trait characterization for corn plants via 3D holographic reconstruction , 2014 .

[9]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[10]  Dongmei Chen,et al.  Examining the effect of spatial resolution and texture window size on classification accuracy: an urban environment case , 2004 .

[11]  P. Wolf,et al.  Elements of Photogrammetry(with Applications in GIS) , 2000 .

[12]  R. Tuberosa.  Phenotyping for drought tolerance of crops in the genomics era , 2012, Front. Physio..

[13]  Mark A. Fonstad,et al.  Topographic structure from motion: a new development in photogrammetric measurement , 2013 .

[14]  J. Léon,et al.  High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plants , 2014 .

[15]  Manuel A. Armada,et al.  A New Approach for Combining Time-of-Flight and RGB Cameras Based on Depth-Dependent Planar Projective Transformations , 2015, Sensors.

[16]  Yanping Yuan,et al.  Quantifying Variation in Soybean Due to Flood Using a Low-Cost 3D Imaging System , 2019, Sensors.

[17]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[18]  C. Daughtry,et al.  Remote Sensing Leaf Chlorophyll Content Using a Visible Band Index , 2011 .

[19]  Marc Olano,et al.  Optimal Altitude, Overlap, and Weather Conditions for Computer Vision UAV Estimates of Forest Structure , 2015, Remote. Sens..

[20]  Ronen Basri,et al.  A Survey on Structure from Motion , 2017, ArXiv.

[21]  Jorge Torres-Sánchez,et al.  Assessing UAV-collected image overlap influence on computation time and digital surface model accuracy in olive orchards , 2018, Precision Agriculture.

[22]  Sindhuja Sankaran,et al.  Development of Automated High-Throughput Phenotyping System for Controlled Environment Studies , 2017 .

[23]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[24]  Lei Tian,et al.  Environmentally adaptive segmentation algorithm for outdoor image segmentation , 1998 .

[25]  Daniel Moura,et al.  In-field crop row phenotyping from 3D modeling performed using Structure from Motion , 2015, Comput. Electron. Agric..

[26]  Ruedi Boesch,et al.  Accuracy Assessment of Digital Surface Models from Unmanned Aerial Vehicles' Imagery on Glaciers , 2017, Remote. Sens..

[27]  R. MacCurdy,et al.  Three-Dimensional Root Phenotyping with a Novel Imaging and Software Platform1[C][W][OA] , 2011, Plant Physiology.

[28]  Wu Bingfang,et al.  Analysis to the relationship of classification accuracy, segmentation scale, image resolution , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[29]  Mark A. Weltz,et al.  Evaluation of structure from motion for soil microtopography measurement , 2014 .

[30]  Gang Liu,et al.  Calculation Method for Phenotypic Traits Based on the 3D Reconstruction of Maize Canopies , 2019, Sensors.

[31]  Arko Lucieer,et al.  Time Series Analysis of Landslide Dynamics Using an Unmanned Aerial Vehicle (UAV) , 2015, Remote. Sens..

[32]  Wang Lei,et al.  Morphological, physiological and biochemical responses of plants to drought stress , 2011 .

[33]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[34]  Henri Eisenbeiss,et al.  UAVS FOR THE DOCUMENTATION OF ARCHAEOLOGICAL EXCAVATIONS , 2010 .

[35]  Brijesh Verma,et al.  On-Tree Mango Fruit Size Estimation Using RGB-D Images , 2017, Sensors.

[36]  Peng Zhang,et al.  3D Imaging of Greenhouse Plants with an Inexpensive Binocular Stereo Vision System , 2017, Remote. Sens..

[37]  Stephen M. Welch,et al.  Plant high-throughput phenotyping using photogrammetry and imaging techniques to measure leaf length and rosette area , 2016, Comput. Electron. Agric..