Conditional Multi-Task learning for Plant Disease Identification

Several recent studies have proposed an automatic plant disease identification system based on deep learning. However, these approaches are generally based on learned classification models with target classes of joint host species-disease pairs that may not allow optimal use of the available information. This is because these approaches require distinguishing between similar host species or diseases, and more importantly, they have limited scalability due to the size of a network gradually increases as new classes are added, despite the fact that information on host species or diseases is already available. This constraint is all the more important as it can be difficult to collect/establish a specific list of all diseases for each host plant species in an actual application. In this paper, we address the problems by proposing a new conditional multi-task learning (CMTL) approach which allows the distribution of host species and disease characteristics learned simultaneously with a conditional link between them. This conditioning is formed in such a way that the knowledge to infer the prediction of one concept (the diseases) depends on the other concept (the host species), which corresponds to the way plant pathologists used to infer the diseases of the host species. We show that our approach can improve the performance of plant disease identification compared to the usual species-disease pair modeling in the previous studies. Meanwhile, we also compose a new dataset on plant disease identification that could serve as an important benchmark in this field.

[1]  I. Deary,et al.  The neuroscience of human intelligence differences , 2010, Nature Reviews Neuroscience.

[2]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Qiang Yang,et al.  An Overview of Multi-task Learning , 2018 .

[5]  P. St-Charles,et al.  Convolutional Neural Networks for the Automatic Identification of Plant Diseases , 2019, Front. Plant Sci..

[6]  Davut Hanbay,et al.  Plant disease and pest detection using deep learning-based features , 2019, Turkish J. Electr. Eng. Comput. Sci..

[7]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[8]  S. Prospero,et al.  Effects of Host Variability on the Spread of Invasive Forest Diseases , 2017 .

[9]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[10]  Yu Zhang,et al.  A Survey on Multi-Task Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[11]  Vishal M. Patel,et al.  C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  R. Ramasamy,et al.  Current and Prospective Methods for Plant Disease Detection , 2015, Biosensors.

[13]  H. A. Hingoliwala,et al.  Smart Farming: Pomegranate Disease Detection Using Image Processing , 2015 .

[14]  Rich Caruana,et al.  Multitask Learning: A Knowledge-Based Source of Inductive Bias , 1993, ICML.

[15]  Roberto Cipolla,et al.  Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Fumio Okura,et al.  How Convolutional Neural Networks Diagnose Plant Disease , 2019, Plant phenomics.

[17]  Roland T. V. Fox,et al.  Plant disease diagnosis , 2006 .

[18]  Aaron C. Courville,et al.  FiLM: Visual Reasoning with a General Conditioning Layer , 2017, AAAI.

[19]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Song-Chun Zhu,et al.  Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Hervé Goëau,et al.  New perspectives on plant disease characterization based on deep learning , 2020, Comput. Electron. Agric..

[22]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[23]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[25]  Jayme Garcia Arnal Barbedo,et al.  Annotated Plant Pathology Databases for Image-Based Detection and Recognition of Diseases , 2018, IEEE Latin America Transactions.

[26]  Darko Stefanovic,et al.  Solving Current Limitations of Deep Learning Based Approaches for Plant Disease Detection , 2019, Symmetry.

[27]  Taesung Park,et al.  Semantic Image Synthesis With Spatially-Adaptive Normalization , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Aaron C. Courville,et al.  Learning Visual Reasoning Without Strong Priors , 2017, ICML 2017.

[29]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..