Generating 3D models from a single 2D digitized photo using GIS and GroIMP

Taking digital photographs as a form of documentation while conducting field work is common practice. There is a wealth of digital photographs collected by foresters who are interested in tree architecture. These high-resolution photographs are two-dimensional representations of the tree structure. However, it is possible to exploit tools such as GIS (e.g., ESRI ArcGIS) and three-dimensional modelling platforms (GroIMP) to extract information from a single digital photograph to three-dimensional modelling. We propose a work flow for creating three-dimensional reconstructions of tree architecture based on a single high-resolution digital photograph. A single digital photograph of tree architecture with a scaling object in view was acquired. The scaled photograph was imported into ArcMap and the tree architecture was digitized, main stem and branching. The DBF file within the shapefile from the GIS output was converted to a CSV file using MS-Excel. GroIMP was used to import the CSV file containing the x and y coordinates and additional information of the digitized tree architecture. Code written in the language XL was used to reconstruct the topology of the stem and branching system and to provide the possibility to create a three-dimensional model for visualization and analysis within GroIMP. This code allows the user to interactively and iteratively manipulate the third coordinate in order to transform a single two-dimensional photograph into a three-dimensional model based on informed decisions.

[1]  Xiaoou Tang,et al.  Symmetric piecewise planar object reconstruction from a single image , 2011, CVPR 2011.

[2]  William S. Warner,et al.  Mapping a three-dimensional soil surface with hand-held 35 mm photography , 1995 .

[3]  Daniel Cremers,et al.  Fast and globally optimal single view reconstruction of curved objects , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  R. Norris,et al.  Prediction of benthic macroinvertebrate composition using microhabitat characteristics derived from stereo photography , 1997 .

[5]  C. Hood Stereophotography in ophthalmology: Part I. , 1986, The Journal of audiovisual media in medicine.

[6]  Ping Tan,et al.  Symmetric architecture modeling with a single image , 2009, SIGGRAPH 2009.

[7]  H. Sinoquet,et al.  Estimating the three-dimensional geometry of a maize crop as an input of radiation models: comparison between three-dimensional digitizing and plant profiles , 1991 .

[8]  Alexei A. Efros,et al.  Automatic photo pop-up , 2005, ACM Trans. Graph..

[9]  Xiaopeng Zhang,et al.  Simple Reconstruction of Tree Branches from a Single Range Image , 2007, Journal of Computer Science and Technology.

[10]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[11]  Suguru Saito,et al.  Single-view sketch based modeling , 2011, SBIM '11.

[12]  Ole Kniemeyer,et al.  Design and implementation of a graph grammar based language for functional-structural plant modelling , 2008 .

[13]  Daniel Cohen-Or,et al.  3-Sweep , 2013, ACM Trans. Graph..

[14]  A.R.G. Lang,et al.  Leaf orientation of a cotton plant , 1973 .

[15]  Michael Henke,et al.  PART OF A SPECIAL ISSUE ON FUNCTIONAL -STRUCTURAL PLANT MODELLING An approach to multiscale modelling with graph grammars , 2014 .

[16]  John J. Videler,et al.  A simple field method for stereo-photographic length measurement of free-swimming fish: Merits and constraints , 1996 .

[17]  Marc Alexa,et al.  Sketch Based Image Deformation , 2007, VMV.

[18]  Long Quan,et al.  Image-based tree modeling , 2007, ACM Trans. Graph..

[19]  Rudi Goossens,et al.  A FEASIBLE METHODOLOGY FOR THE USE OF CLOSE RANGE PHOTOGRAMMETRY FOR THE RECORDING OF ARCHAEOLOGICAL EXCAVATIONS , 2005 .

[20]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  O. Kniemeyer Rule-based modelling with the XL / GroIMP software , 2004 .

[22]  H. Sinoquet,et al.  Assessing the Geometric Structure of a White Clover ( Trifolium repens L.) Canopy using3-D Digitising , 2000 .

[23]  Loong Fah Cheong,et al.  Symmetric architecture modeling with a single image , 2009, ACM Trans. Graph..

[24]  Christophe Godin,et al.  A Method for Describing Plant Architecture which Integrates Topology and Geometry , 1999 .

[25]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[26]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..

[27]  Thiago Teixeira Santos,et al.  Automatic 3D plant reconstruction from photographies, segmentation and classification of leaves and internodes using clustering , 2013 .

[28]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[29]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Sergi Foix,et al.  Indoor and outdoor depth imaging of leaves with time-of-flight and stereo vision sensors: Analysis and comparison , 2014 .

[31]  Yongsheng Gao,et al.  Primitive-based 3D structure inference from a single 2D image for insect modeling: Towards an electronic field guide for insect identification , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[32]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[33]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[34]  Dz Z. Li,et al.  Pollination biology of four Pedicularis species (Scrophulariaceae) in northwestern Yunnan, China , 2005 .

[35]  Baba C. Vemuri,et al.  On Three-Dimensional Surface Reconstruction Methods , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Julie Dorsey,et al.  Reconstructing 3D Tree Models from Instrumented Photographs , 2001, IEEE Computer Graphics and Applications.

[37]  Xinyu Guo,et al.  Multi-scale reconstruction of crop canopy , 2012, 2012 IEEE 4th International Symposium on Plant Growth Modeling, Simulation, Visualization and Applications.

[38]  Ming C. Lin,et al.  Example-guided physically based modal sound synthesis , 2013, ACM Trans. Graph..

[39]  D. Searcy,et al.  Anatomy and morphology of red mangrove (Rhizophora mangle) plants in relation to internal airflow , 2005 .

[40]  Frédo Durand,et al.  2.5D cartoon models , 2010, SIGGRAPH 2010.

[41]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[42]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[43]  Jayme G. A. Barbedo,et al.  3D Plant Modeling: Localization, Mapping and Segmentation for Plant Phenotyping Using a Single Hand-held Camera , 2014, ECCV Workshops.