3D tree dimensionality assessment using photogrammetry and small unmanned aerial vehicles

Detailed, precise, three-dimensional (3D) representations of individual trees are a prerequisite for an accurate assessment of tree competition, growth, and morphological plasticity. Until recently, our ability to measure the dimensionality, spatial arrangement, shape of trees, and shape of tree components with precision has been constrained by technological and logistical limitations and cost. Traditional methods of forest biometrics provide only partial measurements and are labor intensive. Active remote technologies such as LiDAR operated from airborne platforms provide only partial crown reconstructions. The use of terrestrial LiDAR is laborious, has portability limitations and high cost. In this work we capitalized on recent improvements in the capabilities and availability of small unmanned aerial vehicles (UAVs), light and inexpensive cameras, and developed an affordable method for obtaining precise and comprehensive 3D models of trees and small groups of trees. The method employs slow-moving UAVs that acquire images along predefined trajectories near and around targeted trees, and computer vision-based approaches that process the images to obtain detailed tree reconstructions. After we confirmed the potential of the methodology via simulation we evaluated several UAV platforms, strategies for image acquisition, and image processing algorithms. We present an original, step-by-step workflow which utilizes open source programs and original software. We anticipate that future development and applications of our method will improve our understanding of forest self-organization emerging from the competition among trees, and will lead to a refined generation of individual-tree-based forest models.

[1]  Hans-Gerd Maas,et al.  Automatic forest inventory parameter determination from terrestrial laser scanner data , 2008 .

[2]  Anna Gerber,et al.  Opengl Programming Guide The Official Guide To Learning Opengl Versions 3 0 And 3 1 , 2016 .

[3]  Peng Gong,et al.  3D Model-Based Tree Measurement from High-Resolution Aerial Imagery , 2002 .

[4]  Mathias Schardt,et al.  Single tree detection in very high resolution remote sensing data , 2007 .

[5]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[6]  S. Popescu,et al.  Lidar remote sensing of forest biomass : A scale-invariant estimation approach using airborne lasers , 2009 .

[7]  N. Strigul Individual-Based Models and Scaling Methods for Ecological Forestry: Implications of Tree Phenotypic Plasticity , 2012 .

[8]  Simon A. Levin,et al.  Fragile Dominion: Complexity and the Commons , 1999 .

[9]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[10]  L. W. Gysel,et al.  Borders and Openings of Beech-Maple Woodlands in Southern Michigan , 1951 .

[11]  Demetrios Gatziolis,et al.  Dynamic, LiDAR-based assessment of lighting conditions in Pacific Northwest forests , 2012 .

[12]  Craig G. Lorimer,et al.  MINIMUM OPENING SIZES FOR CANOPY RECRUITMENT OF MIDTOLERANT TREE SPECIES: A RETROSPECTIVE APPROACH , 2005 .

[13]  S. Popescu,et al.  A voxel-based lidar method for estimating crown base height for deciduous and pine trees , 2008 .

[14]  R. E. Shanks,et al.  Natural Replacement of Chestnut by Other Species in the Great Smoky Mountains National Park , 1959 .

[15]  Felix Morsdorf,et al.  Understory trees in airborne LiDAR data — Selective mapping due to transmission losses and echo-triggering mechanisms , 2012 .

[16]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[18]  Demetrios Gatziolis,et al.  Modeling Forest Aboveground Biomass and Volume Using Airborne LiDAR Metrics and Forest Inventory and Analysis Data in the Pacific Northwest , 2014, Remote. Sens..

[19]  Warren B. Cohen,et al.  Modeling Percent Tree Canopy Cover: A Pilot Study , 2012 .

[20]  Craig Loehle,et al.  Phototropism of Whole Trees: Effects of Habitat and Growth Form , 1986 .

[21]  Richard A. Fournier,et al.  The structural and radiative consistency of three-dimensional tree reconstructions from terrestrial lidar , 2009 .

[22]  L. Monika Moskal,et al.  Fusion of LiDAR and imagery for estimating forest canopy fuels , 2010 .

[23]  Frank Dellaert,et al.  Saliency detection and model-based tracking: a two part vision system for small robot navigation in forested environment , 2012, Defense, Security, and Sensing.

[24]  Sungmoon Joo,et al.  Adaptive receding horizon control for vision-based navigation of small unmanned aircraft , 2006, 2006 American Control Conference.

[25]  Caterina Balletti,et al.  Calibration of Action Cameras for Photogrammetric Purposes , 2014, Sensors.

[26]  P. Radtke,et al.  Detailed Stem Measurements of Standing Trees from Ground-Based Scanning Lidar , 2006, Forest Science.

[27]  Rahul Sukthankar,et al.  Classification of plant structures from uncalibrated image sequences , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[28]  S. Popescu,et al.  Measuring individual tree crown diameter with lidar and assessing its influence on estimating forest volume and biomass , 2003 .

[29]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[30]  Eija Honkavaara,et al.  Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera , 2012, Sensors.

[31]  K. O. Niemann,et al.  Local Maximum Filtering for the Extraction of Tree Locations and Basal Area from High Spatial Resolution Imagery , 2000 .

[32]  Peter Stoll,et al.  Plant foraging and dynamic competition between branches of Pinus sylvestris in contrasting light environments , 1998 .

[33]  Changchang Wu,et al.  Critical Configurations for Radial Distortion Self-Calibration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[35]  Nate G. McDowell,et al.  Automated tree crown detection and size estimation using multi-scale analysis of high-resolution satellite imagery , 2013 .

[36]  Lee E. Frelich,et al.  Effects of Crown Expansion into Gaps on Evaluation of Disturbance Intensity in Northern Hardwood Forests , 1988 .

[37]  S. Reutebuch,et al.  A rigorous assessment of tree height measurements obtained using airborne lidar and conventional field methods , 2006 .

[38]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[39]  Conghe Song,et al.  Estimating tree crown size with spatial information of high resolution optical remotely sensed imagery , 2007 .

[40]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[41]  Kiyoshi Umeki,et al.  A comparison of crown asymmetry between Piceaabies and Betulamaximowicziana , 1995 .

[42]  Erle C. Ellis,et al.  High spatial resolution three-dimensional mapping of vegetation spectral dynamics using computer vision , 2013 .

[43]  M. Rothermel,et al.  SURE : PHOTOGRAMMETRIC SURFACE RECONSTRUCTION FROM IMAGER Y , 2013 .

[44]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[45]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[46]  J. Dushoff,et al.  SCALING FROM TREES TO FORESTS: TRACTABLE MACROSCOPIC EQUATIONS FOR FOREST DYNAMICS , 2008 .

[47]  D. Leckie,et al.  Automated tree recognition in old growth conifer stands with high resolution digital imagery , 2005 .

[48]  Emilio Frazzoli,et al.  High-speed flight in an ergodic forest , 2012, 2012 IEEE International Conference on Robotics and Automation.

[49]  Erle C. Ellis,et al.  Remote Sensing of Vegetation Structure Using Computer Vision , 2010, Remote. Sens..

[50]  Jacques Brisson,et al.  Neighborhood competition and crown asymmetry in Acer saccharum , 2001 .

[51]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[52]  Josechu J. Guerrero,et al.  Photogrammetric Methodology for the Production of Geomorphologic Maps: Application to the Veleta Rock Glacier (Sierra Nevada, Granada, Spain) , 2009, Remote. Sens..

[53]  E. Schulze,et al.  Crown modeling by terrestrial laser scanning as an approach to assess the effect of aboveground intra- and interspecific competition on tree growth , 2013 .

[54]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[55]  Vicente S. Monleon,et al.  Challenges to Estimating Tree Height via LiDAR in Closed-Canopy Forests: A Parable from Western Oregon , 2010, Forest Science.

[56]  I. Reda,et al.  Solar position algorithm for solar radiation applications , 2004 .

[57]  Sebastian Scherer,et al.  First results in detecting and avoiding frontal obstacles from a monocular camera for micro unmanned aerial vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[58]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.