Transfer Learning from Synthetic Data Applied to Soil-Root Segmentation in X-Ray Tomography Images

One of the most challenging computer vision problems in the plant sciences is the segmentation of roots and soil in X-ray tomography. So far, this has been addressed using classical image analysis methods. In this paper, we address this soil–root segmentation problem in X-ray tomography using a variant of supervised deep learning-based classification called transfer learning where the learning stage is based on simulated data. The robustness of this technique, tested for the first time with this plant science problem, is established using soil–roots with very low contrast in X-ray tomography. We also demonstrate the possibility of efficiently segmenting the root from the soil while learning using purely synthetic soil and roots.

[1]  Yann Gousseau,et al.  Modeling Occlusion and Scaling in Natural Images , 2007, Multiscale Model. Simul..

[2]  Tony P. Pridmore,et al.  Deep Machine Learning provides state-of-the-art performance in image-based plant phenotyping , 2016 .

[3]  F. Chapeau-Blondeau,et al.  Multiscale analysis of depth images from natural scenes: Scaling in the depth of the woods , 2013 .

[4]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[5]  Stefan Mairhofer,et al.  On the evaluation of methods for the recovery of plant root systems from X-ray computed tomography images. , 2015, Functional plant biology : FPB.

[6]  Jochen Hemming,et al.  Data synthesis methods for semantic segmentation in agriculture: A Capsicum annuum dataset , 2018, Comput. Electron. Agric..

[7]  Ulrich Schurr,et al.  Direct comparison of MRI and X-ray CT technologies for 3D imaging of root systems in soil: potential and challenges for root trait quantification , 2015, Plant Methods.

[8]  Olarik Surinta,et al.  Comparing Local Descriptors and Bags of Visual Words to Deep Convolutional Neural Networks for Plant Recognition , 2017, ICPRAM.

[9]  Stefan Mairhofer,et al.  RooTrak: Automated Recovery of Three-Dimensional Plant Root Architecture in Soil from X-Ray Microcomputed Tomography Images Using Visual Tracking1[W] , 2011, Plant Physiology.

[10]  Patrick Flandrin,et al.  Time-Frequency/Time-Scale Analysis , 1998 .

[11]  Przemyslaw Prusinkiewicz,et al.  The use of plant models in deep learning: an application to leaf counting in rosette plants , 2018, Plant Methods.

[12]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[13]  S. Mallat A wavelet tour of signal processing , 1998 .

[14]  Hanno Scharr,et al.  Finely-grained annotated datasets for image-based plant phenotyping , 2016, Pattern Recognit. Lett..

[15]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[16]  Etienne Belin,et al.  Simulation of image acquisition in machine vision dedicated to seedling elongation to validate image processing root segmentation algorithms , 2014 .

[17]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[18]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[19]  Loïc Pagès,et al.  Using a Structural Root System Model to Evaluate and Improve the Accuracy of Root Image Analysis Pipelines , 2017, Frontiers in plant science.

[20]  H. Sebastian Seung,et al.  Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification , 2017, Bioinform..

[21]  Hanno Scharr,et al.  ARIGAN: Synthetic Arabidopsis Plants using Generative Adversarial Network , 2017, bioRxiv.

[22]  Daniel Leitner,et al.  A dynamic root system growth model based on L-Systems , 2010, Plant and Soil.

[23]  David Rousseau,et al.  Fractal capacity dimension of three-dimensional histogram from color images , 2010, Multidimens. Syst. Signal Process..

[24]  Lambert Schomaker,et al.  Data Augmentation for Plant Classification , 2017, ACIVS.

[25]  Liliane Maria Romualdo,et al.  Comparison Between Traditional Texture Methods and Deep Learning Descriptors for Detection of Nitrogen Deficiency in Maize Crops , 2017, 2017 Workshop of Computer Vision (WVC).

[26]  F. Chapeau-Blondeau,et al.  Fractal structure in the color distribution of natural images , 2009 .

[27]  Xiangfeng Wang,et al.  Machine learning for Big Data analytics in plants. , 2014, Trends in plant science.

[28]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[29]  T. Pridmore,et al.  Computer Vision Problems in Plant Phenotyping, CVPPP 2017: Introduction to the CVPPP 2017 Workshop Papers , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[30]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[31]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..