Deep Learning Application in Plant Stress Imaging: A Review

Plant stress is one of major issues that cause significant economic loss for growers. The labor-intensive conventional methods for identifying the stressed plants constrain their applications. To address this issue, rapid methods are in urgent needs. Developments of advanced sensing and machine learning techniques trigger revolutions for precision agriculture based on deep learning and big data. In this paper, we reviewed the latest deep learning approaches pertinent to the image analysis of crop stress diagnosis. We compiled the current sensor tools and deep learning principles involved in plant stress phenotyping. In addition, we reviewed a variety of deep learning applications/functions with plant stress imaging, including classification, object detection, and segmentation, of which are closely intertwined. Furthermore, we summarized and discussed the current challenges and future development avenues in plant phenotyping.

[1]  Xin Zhang,et al.  A Deep Learning-Based Approach for Automated Yellow Rust Disease Detection from High-Resolution Hyperspectral UAV Images , 2019, Remote. Sens..

[2]  Hiroshi Mineno,et al.  Multi-modal sliding window-based support vector regression for predicting plant water stress , 2017, Knowl. Based Syst..

[3]  C. Vanniarajan,et al.  Improved host-plant resistance to Phytophthora rot and powdery mildew in soybean (Glycine max (L.) Merr.) , 2020, Scientific Reports.

[4]  Jayme Garcia Arnal Barbedo,et al.  Digital image processing techniques for detecting, quantifying and classifying plant diseases. , 2013 .

[5]  Hong Zhang,et al.  Rice Blast Disease Recognition Using a Deep Convolutional Neural Network , 2019, Scientific Reports.

[6]  Yunseop Kim,et al.  Hyperspectral image analysis for water stress detection of apple trees , 2011 .

[7]  Changshui Zhang,et al.  An In-field Automatic Wheat Disease Diagnosis System , 2017, Comput. Electron. Agric..

[8]  Andrea Luvisi,et al.  Detection of grapevine yellows symptoms in Vitis vinifera L. with artificial intelligence , 2019, Comput. Electron. Agric..

[9]  José G. M. Esgario,et al.  Deep Learning for Classification and Severity Estimation of Coffee Leaf Biotic Stress , 2019, Comput. Electron. Agric..

[10]  Jing Zhang,et al.  Branch detection for apple trees trained in fruiting wall architecture using depth features and Regions-Convolutional Neural Network (R-CNN) , 2018, Comput. Electron. Agric..

[11]  A. Rath,et al.  Rice false smut detection based on faster R-CNN , 2020 .

[12]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[13]  Baskar Ganapathysubramanian,et al.  An explainable deep machine vision framework for plant stress phenotyping , 2018, Proceedings of the National Academy of Sciences.

[14]  Wenting Han,et al.  Mapping Maize Water Stress Based on UAV Multispectral Remote Sensing , 2019, Remote. Sens..

[15]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[16]  Andrew M Mutka,et al.  Image-based phenotyping of plant disease symptoms , 2015, Front. Plant Sci..

[17]  Hong-Yi Chang,et al.  The Pest and Disease Identification in the Growth of Sweet Peppers Using Faster R-CNN and Mask R-CNN , 2020 .

[18]  Lav R. Khot,et al.  Optical sensing for early spring freeze related blueberry bud damage detection: Hyperspectral imaging for salient spectral wavelengths identification , 2019, Comput. Electron. Agric..

[19]  P. St-Charles,et al.  Convolutional Neural Networks for the Automatic Identification of Plant Diseases , 2019, Front. Plant Sci..

[20]  Hod Lipson,et al.  Quantitative Phenotyping of Northern Leaf Blight in UAV Images Using Deep Learning , 2019, Remote. Sens..

[21]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[22]  Gustavo A. Slafer,et al.  Detecting interactive effects of N fertilization and heat stress on maize productivity by remote sensing techniques , 2016 .

[23]  H. Lichtenthaler,et al.  Imaging of the Blue, Green, and Red Fluorescence Emission of Plants: An Overview , 2000, Photosynthetica.

[24]  Nadeem Akhtar,et al.  Interpretation of intelligence in CNN-pooling processes: a methodological survey , 2019, Neural Computing and Applications.

[25]  Thomas Udelhoven,et al.  Water stress detection in potato plants using leaf temperature, emissivity, and reflectance , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[26]  Yixiang Huang,et al.  Deep Learning-Based Segmentation and Quantification of Cucumber Powdery Mildew Using Convolutional Neural Network , 2019, Front. Plant Sci..

[27]  Yongxian Wang,et al.  Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning , 2020 .

[28]  Aamir Saeed Malik,et al.  Scene classification for aerial images based on CNN using sparse coding technique , 2017 .

[29]  Minghe Sun,et al.  Identification of Tomato Disease Types and Detection of Infected Areas Based on Deep Convolutional Neural Networks and Object Detection Techniques , 2019, Comput. Intell. Neurosci..

[30]  Jin Tae Kwak,et al.  Deep convolutional neural network for classifying Fusarium wilt of radish from unmanned aerial vehicles , 2017 .

[31]  Shuai Wang,et al.  Classifying Wheat Hyperspectral Pixels of Healthy Heads and Fusarium Head Blight Disease Using a Deep Neural Network in the Wild Field , 2018, Remote. Sens..

[32]  Wanyi Li,et al.  Identification and Classification of Maize Drought Stress Using Deep Convolutional Neural Network , 2019, Symmetry.

[33]  Giulio Reina,et al.  A Survey of Ranging and Imaging Techniques for Precision Agriculture Phenotyping , 2017, IEEE/ASME Transactions on Mechatronics.

[34]  Yang Tao,et al.  Early Detection of Tomato Spotted Wilt Virus by Hyperspectral Imaging and Outlier Removal Auxiliary Classifier Generative Adversarial Nets (OR-AC-GAN) , 2019, Scientific Reports.

[35]  Min Xu,et al.  Strawberry Verticillium Wilt Detection Network Based on Multi-Task Learning and Attention , 2019, IEEE Access.

[36]  Christian Germain,et al.  Comparison of SIFT Encoded and Deep Learning Features for the Classification and Detection of Esca Disease in Bordeaux Vineyards , 2018, Remote. Sens..

[37]  J. Araus,et al.  Field high-throughput phenotyping: the new crop breeding frontier. , 2014, Trends in plant science.

[38]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[39]  François Anctil,et al.  Comparing Sigmoid Transfer Functions for Neural Network Multistep Ahead Streamflow Forecasting , 2010 .

[40]  J. Yosinski,et al.  Automated Identification of Northern Leaf Blight-Infected Maize Plants from Field Imagery Using Deep Learning. , 2017, Phytopathology.

[41]  Jinpeng Li,et al.  Application of chlorophyll fluorescence imaging technique in analysis and detection of chilling injury of tomato seedlings , 2020, Comput. Electron. Agric..

[42]  Lingxian Zhang,et al.  A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network , 2018, Comput. Electron. Agric..

[43]  Wei Sun,et al.  PD2SE-Net: Computer-assisted plant disease diagnosis and severity estimation network , 2019, Comput. Electron. Agric..

[44]  Payel Ghosh,et al.  Incorporating priors for medical image segmentation using a genetic algorithm , 2016, Neurocomputing.

[45]  Jayme Garcia Arnal Barbedo,et al.  Plant disease identification from individual lesions and spots using deep learning , 2019, Biosystems Engineering.

[46]  Yun Zhang,et al.  Identification of Apple Leaf Diseases Based on Deep Convolutional Neural Networks , 2017, Symmetry.

[47]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[48]  Ronghua Shang,et al.  Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Sang Cheol Kim,et al.  A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition , 2017, Sensors.

[50]  Yan Zhang,et al.  A low shot learning method for tea leaf's disease identification , 2019, Comput. Electron. Agric..

[51]  Ashutosh Kumar Singh,et al.  Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives. , 2018, Trends in plant science.

[52]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[53]  Ulrike Steiner,et al.  Effect of downy mildew development on transpiration of cucumber leaves visualized by digital infrared thermography. , 2005, Phytopathology.

[54]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[55]  Stéphane Mallat,et al.  Understanding deep convolutional networks , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[56]  Tao Cheng,et al.  Combining computer vision and deep learning to enable ultra-scale aerial phenotyping and precision agriculture: A case study of lettuce production , 2019, Horticulture Research.

[57]  Anne-Katrin Mahlein.  Plant Disease Detection by Imaging Sensors - Parallels and Specific Demands for Precision Agriculture and Plant Phenotyping. , 2016, Plant disease.

[58]  David Hughes,et al.  Deep Learning for Image-Based Cassava Disease Detection , 2017, Front. Plant Sci..

[59]  Muhammad Awais,et al.  CCDF: Automatic system for segmentation and recognition of fruit crops diseases based on correlation coefficient and deep CNN features , 2018, Comput. Electron. Agric..

[60]  Yun Shi,et al.  Cucumber leaf disease identification with global pooling dilated convolutional neural network , 2019, Comput. Electron. Agric..

[61]  E. Mazzucotelli,et al.  Drought tolerance improvement in crop plants: An integrated view from breeding to genomics , 2008 .