Use of digital images to disclose canopy architecture in olive tree

Abstract The use of digital cameras for monitoring natural vegetation and agricultural ecosystems is particularly attractive since it necessitates neither expensive equipment nor extensive skill. In this study we tested the use of digital images (DIs) to generate 3D plant reconstruction for retrieving the main plant architectural features (leaf area, leaf inclination, leaf azimuth) of olive tree branches. High resolution image of tree branches were firstly used to generate 3D reconstruction of plant structures using a Structure From Motion approach; we therefore answered the question whether these 3D models may be segmented to discriminate main plant structures (leaves and branch) proposing a simple classification algorithm (Random Forest, RF) with saliency features and color indices as predictors. Finally, on the good and robust performances of the proposed classification algorithm, the single leaves were analyzed to retrieve the relevant area, inclination and orientation and compared to the relevant observed data. The calibration of the RF model indicated that color indices better discriminated leaves and stem than the sole use of saliency features. The classification performances were further improved by tuning the scale at which saliency features were calculated and by filtering the final result to reduce misclassified points. A RF model calibrated on a single plant was successfully applied to 5 others, indicating the robustness of the calibration strategy. The analysis of single leaves, as segmented after the classification process, indicated that plant architecture was satisfactorily reproduced with strong correlations obtained between measured and calculated values of leaf inclination and azimuth, while biases were observed for leaf area. These results emphasize the effectiveness of SFM in reproducing complex arrangements of leaves like on an olive tree. The use of such a system can be therefore suggested as a first step towards an improved low cost plant phenotyping platform to speed up our understanding of plant responses to environment. Further experiments are required to test the effectiveness of the approach also under outdoor conditions.

[1]  S. Brantley,et al.  Leaf-area index and light attenuation in rapidly expanding shrub thickets. , 2007, Ecology.

[2]  B. Andrieu,et al.  Computer stereo plotting for 3-D reconstruction of a maize canopy , 1995 .

[3]  J. Pisek,et al.  Estimating leaf inclination and G-function from leveled digital camera photography in broadleaf canopies , 2011, Trees.

[4]  Pablo J. Zarco-Tejada,et al.  High-Resolution Airborne UAV Imagery to Assess Olive Tree Crown Parameters Using 3D Photo Reconstruction: Application in Breeding Trials , 2015, Remote. Sens..

[5]  H. Scharr,et al.  The leaf angle distribution of natural plant populations: assessing the canopy with a novel software tool , 2015, Plant Methods.

[6]  Daniel Moura,et al.  In-field crop row phenotyping from 3D modeling performed using Structure from Motion , 2015, Comput. Electron. Agric..

[7]  Omri Allouche,et al.  Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS) , 2006 .

[8]  Xiaochen Zou,et al.  Photographic measurement of leaf angles in field crops , 2014 .

[9]  Heiner Kuhlmann,et al.  Accuracy Analysis of a Multi-View Stereo Approach for Phenotyping of Tomato Plants at the Organ Level , 2015, Sensors.

[10]  R. McMurtrie,et al.  Estimation of leaf area index in eucalypt forest using digital photography , 2007 .

[11]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[12]  Raffaele Casa,et al.  Development of an app for estimating leaf area index using a smartphone. Trueness and precision determination and comparison with other indirect methods , 2013 .

[13]  Shaozhong Kang,et al.  Canopy leaf area index for apple tree using hemispherical photography in arid region , 2013 .

[14]  David Zhang,et al.  A novel line scan clustering algorithm for identifying connected components in digital images , 2003, Image Vis. Comput..

[15]  Adam J. Mathews,et al.  Visualizing and Quantifying Vineyard Canopy LAI Using an Unmanned Aerial Vehicle (UAV) Collected High Density Structure from Motion Point Cloud , 2013, Remote. Sens..

[16]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[17]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[18]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[19]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[20]  M. Rossini,et al.  Using digital repeat photography and eddy covariance data to model grassland phenology and photosynthetic CO2 uptake , 2011 .

[21]  S. Robson,et al.  Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application , 2012 .

[22]  Sigfredo Fuentes,et al.  An automated procedure for estimating the leaf area index (LAI) of woodland ecosystems using digital imagery, MATLAB programming and its application to an examination of the relationship between remotely sensed and field measurements of LAI. , 2008, Functional plant biology : FPB.

[23]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[24]  J. Evans,et al.  Modeling Species Distribution and Change Using Random Forest , 2011 .

[25]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[26]  Hideki Kobayashi,et al.  How to quantify tree leaf area index in an open savanna ecosystem: A multi-instrument and multi-model approach , 2010 .

[27]  D. R. Cutler,et al.  Utah State University From the SelectedWorks of , 2017 .

[28]  J. Phattaralerphong,et al.  A method for 3D reconstruction of tree crown volume from photographs: assessment with 3D-digitized plants. , 2005, Tree physiology.

[29]  J. Phattaralerphong,et al.  A photographic gap fraction method for estimating leaf area of isolated trees: Assessment with 3D digitized plants. , 2006, Tree physiology.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Pablo J. Zarco-Tejada,et al.  Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods , 2014 .

[32]  Erle C. Ellis,et al.  Remote Sensing of Vegetation Structure Using Computer Vision , 2010, Remote. Sens..

[33]  Piermaria Corona,et al.  Estimation of leaf area index in understory deciduous trees using digital photography , 2014 .

[34]  Elizabeth Pattey,et al.  Assessment of in situ crop LAI measurement using unidirectional view digital photography , 2013 .

[35]  Peter Biber,et al.  Plant detection and mapping for agricultural robots using a 3D LIDAR sensor , 2011, Robotics Auton. Syst..

[36]  Wang Xingyu,et al.  A new approach for measuring 3D digitalized rape leaf parameters based on images , 2014, 2014 The Third International Conference on Agro-Geoinformatics.