On the use of depth camera for 3D phenotyping of entire plants

In this article, we assess the potential of depth imaging systems for 3D measurements in the context of plant phenotyping. We propose an original algorithm to segment depth images of plant from a single top-view. Various applications of biological interest involving for illustration rosebush, yucca and apple tree are then presented to demonstrate the practical interest of such imaging systems. In addition, the depth camera used here is very low cost and low weight. The present results therefore open interesting perspectives in the direction of high-throughput phenotyping in controlled environment or in field conditions.

[1]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[2]  Norbert Pfeifer,et al.  Structuring laser-scanned trees using 3D mathematical morphology , 2004 .

[3]  Gaurav S. Sukhatme,et al.  3D tree reconstruction from laser range data , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Marc Jaeger,et al.  Reconstruction of Tree Crown Shape from Scanned Data , 2008, Edutainment.

[5]  Shengyong Chen,et al.  Active Sensor Planning for Multiview Vision Tasks , 2008 .

[6]  Jörg Stückler,et al.  Combining depth and color cues for scale- and viewpoint-invariant object segmentation and recognition using Random Forests , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Yung-Sheng Chen,et al.  Leaf Segmentation, Its 3D Position Estimation and Leaf Classification from a Few Images with Very Close Viewpoints , 2009, ICIAR.

[8]  Natsuko Toyofuku,et al.  Automatic image analysis and spot classification for detection of pathogenic Escherichia coli on glass slide DNA microarrays , 2010 .

[9]  K. Omasa,et al.  3D lidar imaging for detecting and understanding plant responses and canopy structure. , 2006, Journal of experimental botany.

[10]  Paul-Henry Cournède,et al.  NEMA, a functional-structural model of nitrogen economy within wheat culms after flowering. II. Evaluation and sensitivity analysis. , 2011, Annals of botany.

[11]  Andreas König.  Knowledge-Based and Intelligent Information and Engineering Systems - 15th International Conference, KES 2011, Kaiserslautern, Germany, September 12-14, 2011, Proceedings, Part IV , 2011, KES.

[12]  Chakkrit Preuksakarn,et al.  Reconstructing plant architecture from 3D laser scanner data. (Acquisition et validation de modèles architecturaux virtuels de plantes) , 2012 .

[13]  H. Scharr,et al.  A stereo imaging system for measuring structural parameters of plant canopies. , 2007, Plant, cell & environment.

[14]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[15]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[16]  Jan Vos,et al.  Understanding shoot branching by modelling form and function. , 2011, Trends in plant science.

[17]  El Mostafa Qannari,et al.  Sensory profiles and preference analysis in ornamental horticulture: The case of the rosebush , 2010 .

[18]  Li Li,et al.  Robust Depth Camera Based Eye Localization for Human-Machine Interactions , 2011, KES.

[19]  Domenec Puig,et al.  Real-time body gesture recognition using depth camera , 2011 .

[20]  Tino Dornbusch,et al.  Description and visualization of graminaceous plants with an organ-based 3D architectural model, exemplified for spring barley (Hordeum vulgare L.) , 2007, The Visual Computer.

[21]  Etienne Belin,et al.  Rate-distortion tradeoff to optimize high-throughput phenotyping systems. Application to X-ray images of seeds , 2011 .

[22]  Richard A. Fournier,et al.  The structural and radiative consistency of three-dimensional tree reconstructions from terrestrial lidar , 2009 .

[23]  B. Andrieu,et al.  Functional-structural plant modelling: a new versatile tool in crop science. , 2010, Journal of experimental botany.

[24]  Loïc Pagès,et al.  Tracing root development using the soft X-ray radiographic method, as applied to young cuttings of western red cedar (Thuja plicata) , 1999 .

[25]  Christophe Fiorio,et al.  Weed leaf recognition in complex natural scenes by model-guided edge pairing. , 2003 .

[26]  H. Jones,et al.  Monitoring and screening plant populations with combined thermal and chlorophyll fluorescence imaging. , 2007, Journal of experimental botany.

[27]  U. Steiner,et al.  Journal of Experimental Botany Advance Access published May 19, 2006 Journal of Experimental Botany, Page 1 of 12 , 2022 .

[28]  Xiaolong Yan,et al.  3D reconstruction and dynamic modeling of root architecture in situ and its application to crop phosphorus research. , 2009, The Plant journal : for cell and molecular biology.

[29]  I. Jonckheere,et al.  Influence of measurement set-up of ground-based LiDAR for derivation of tree structure , 2006 .

[30]  K. Omasa,et al.  Factors contributing to accuracy in the estimation of the woody canopy leaf area density profile using 3D portable lidar imaging. , 2007, Journal of experimental botany.

[31]  Dong-Ming Yan,et al.  Efficient and robust reconstruction of botanical branching structure from laser scanned points , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[32]  V. Bus,et al.  Venturia inaequalis: the causal agent of apple scab. , 2011, Molecular plant pathology.

[33]  Paul-Henry Cournède,et al.  NEMA, a functional-structural model of nitrogen economy within wheat culms after flowering. I. Model description. , 2011, Annals of botany.

[34]  Margarita Ruiz-Altisent,et al.  Review: Sensors for product characterization and quality of specialty crops-A review , 2010 .