3D Phenotyping of Plants

In recent years, there has been significant progress in computer vision based plant phenotyping technologies. Due to their non-invasive and non-contact properties, imaging techniques are becoming state of the art in automated plant phenotyping analysis. There are several aspects of phenotyping, including plant growth, organ classification and tracking, disease detection, etc. This chapter presents a broad overview of computer vision based 3D plant phenotyping techniques. Some case studies of state-of-the-art techniques are described in detail. In the first case study, automated robotic systems for 3D plant phenotyping are discussed. The second study focuses on general registration techniques of point cloud and alignment of multiple view challenging plant point cloud data. Next, recently successful plant organ segmentation techniques are reviewed. Finally, some open challenges of vision-based plant phenotyping are discussed, followed by conclusion and some hands on exercises.

[1]  Fei Zhao,et al.  Coronary artery tree tracking with robust junction detection in 3D CT Angiography , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Christian Klukas,et al.  Integrated Analysis Platform: An Open-Source Information System for High-Throughput Plant Phenotyping1[C][W][OPEN] , 2014, Plant Physiology.

[3]  Daniel Cohen-Or,et al.  Analyzing growing plants from 4D point cloud data , 2013, ACM Trans. Graph..

[4]  Nathan D. Miller,et al.  Image analysis is driving a renaissance in growth measurement. , 2013, Current opinion in plant biology.

[5]  Ayan Chaudhury,et al.  A Method for Global Non-rigid Registration of Multiple Thin Structures , 2015, 2015 12th Conference on Computer and Robot Vision.

[6]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hanno Scharr,et al.  Leaf segmentation in plant phenotyping: a collation study , 2016, Machine Vision and Applications.

[8]  Sebastian Riedel,et al.  Automated Analysis of Barley Organs Using 3D Laser Scanning: An Approach for High Throughput Phenotyping , 2014, Sensors.

[9]  Christophe Godin,et al.  Quantifying the Degree of Self-Nestedness of Trees: Application to the Structural Analysis of Plants , 2010, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[10]  Henry Medeiros,et al.  Modeling Dormant Fruit Trees for Agricultural Automation , 2017, J. Field Robotics.

[11]  Gert Kootstra,et al.  Validation of plant part measurements using a 3D reconstruction method suitable for high-throughput seedling phenotyping , 2015, Machine Vision and Applications.

[12]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[13]  Carlos Fernández Andrés,et al.  Development of a Configurable Growth Chamber with a Computer Vision System to Study Circadian Rhythm in Plants , 2012, Sensors.

[14]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[15]  Kobus Barnard,et al.  Branching Gaussian Processes with Applications to Spatiotemporal Reconstruction of 3D Trees , 2016, ECCV.

[16]  Hanno Scharr,et al.  Finely-grained annotated datasets for image-based plant phenotyping , 2016, Pattern Recognit. Lett..

[17]  Ayan Chaudhury,et al.  Junction-Based Correspondence Estimation of Plant Point Cloud Data Using Subgraph Matching , 2016, IEEE Geoscience and Remote Sensing Letters.

[18]  Tristan Perez,et al.  Peduncle Detection of Sweet Pepper for Autonomous Crop Harvesting—Combined Color and 3-D Information , 2017, IEEE Robotics and Automation Letters.

[19]  J. Barron,et al.  Measuring 3‐D plant growth using optical flow , 1997 .

[20]  Yll Haxhimusa,et al.  A framework for the extraction of quantitative traits from 2D images of mature Arabidopsis thaliana , 2016, Machine Vision and Applications.

[21]  D. Inzé,et al.  Cell to whole-plant phenotyping: the best is yet to come. , 2013, Trends in plant science.

[22]  J. Barron,et al.  Optical flow to measure minute increments in plant growth , 1994 .

[23]  J. Léon,et al.  High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plants , 2014 .

[24]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Kristian Kersting,et al.  Automated interpretation of 3D laserscanned point clouds for plant organ segmentation , 2015, BMC Bioinformatics.

[26]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[27]  José Luis Pons Rovira,et al.  Machine Vision and Applications Manuscript-nr. a Vision System Based on a Laser Range--nder Applied to Robotic Fruit Harvesting , 2022 .

[28]  John L. Barron,et al.  Oscillations in Corn Seedling Growth as Measured by Optical Flow , 1995 .

[29]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Etienne Belin,et al.  Simulation of image acquisition in machine vision dedicated to seedling elongation to validate image processing root segmentation algorithms , 2014 .

[32]  Rajnikant V. Patel,et al.  Machine Vision System for 3D Plant Phenotyping , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[33]  Tony P. Pridmore,et al.  A patch-based approach to 3D plant shoot phenotyping , 2016, Machine Vision and Applications.

[34]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.

[35]  Frank F. Millenaar,et al.  Plant Movement. Submergence-Induced Petiole Elongation inRumex palustris Depends on Hyponastic Growth1 , 2003, Plant Physiology.

[36]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[37]  Michael P. Pound,et al.  Approaches to three-dimensional reconstruction of plant shoot topology and geometry. , 2016, Functional plant biology : FPB.

[38]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[39]  I. Xenarios,et al.  Measuring the diurnal pattern of leaf hyponasty and growth in Arabidopsis - a novel phenotyping approach using laser scanning. , 2012, Functional plant biology : FPB.

[40]  J. Fripp,et al.  A novel mesh processing based technique for 3D plant analysis , 2012, BMC Plant Biology.

[41]  Thiago T. Santos,et al.  Flexible three-dimensional modeling of plants using low- resolution cameras and visual odometry , 2015, Machine Vision and Applications.

[42]  Hanno Scharr,et al.  Growth Signatures of Rosette Plants from Time-Lapse Video , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[43]  Christian Cachard,et al.  Model Fitting Using RANSAC for Surgical Tool Localization in 3-D Ultrasound Images , 2010, IEEE Transactions on Biomedical Engineering.

[44]  Norberto M. Grzywacz,et al.  A computational theory for the perception of coherent visual motion , 1988, Nature.

[45]  Nicola J. Ferrier,et al.  A high throughput robot system for machine vision based plant phenotype studies , 2012, Machine Vision and Applications.

[46]  Hanno Scharr,et al.  Modeling leaf growth of rosette plants using infrared stereo image sequences , 2015, Comput. Electron. Agric..

[47]  Yongqiang Ye,et al.  Use of leaf color images to identify nitrogen and potassium deficient tomatoes , 2011, Pattern Recognit. Lett..

[48]  Jayme G. A. Barbedo,et al.  3D Plant Modeling: Localization, Mapping and Segmentation for Plant Phenotyping Using a Single Hand-held Camera , 2014, ECCV Workshops.

[49]  Roberto Toldo,et al.  Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework , 2010 .

[50]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[51]  Henry Medeiros,et al.  Measuring and modeling apple trees using time-of-flight data for automation of dormant pruning applications , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[52]  Miguel Á. Carreira-Perpiñán,et al.  Non-rigid point set registration: Coherent Point Drift , 2006, NIPS.

[53]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[54]  Tony P. Pridmore,et al.  Surface Reconstruction of Plant Shoots from Multiple Views , 2014, ECCV Workshops.

[55]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[56]  Daniel Cremers,et al.  Field phenotyping of grapevine growth using dense stereo reconstruction , 2015, BMC Bioinformatics.

[57]  Kourosh Khoshelham,et al.  Localized Registration of Point Clouds of Botanic Trees , 2013, IEEE Geoscience and Remote Sensing Letters.

[58]  Jinhai Cai,et al.  High-throughput 3D modelling of plants for phenotypic analysis , 2012, IVCNZ '12.

[59]  Michael P. Pound,et al.  Plant Phenotyping: An Active Vision Cell for Three-Dimensional Plant Shoot Reconstruction1[OPEN] , 2018, Plant Physiology.

[60]  Jin Liu,et al.  Stem–Leaf Segmentation and Phenotypic Trait Extraction of Individual Maize Using Terrestrial LiDAR Data , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Shang Gao,et al.  Deep Learning: Individual Maize Segmentation From Terrestrial Lidar Data Using Faster R-CNN and Regional Growth Algorithms , 2018, Front. Plant Sci..

[62]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[63]  Toni Kazic,et al.  Extracting complex lesion phenotypes in Zea mays , 2015, Machine Vision and Applications.