Machine vision-based automatic disease symptom detection of onion downy mildew

Abstract The effective crop management is major issue in recent agriculture because the cultivation area per farmer is increasing consistently while the aging-related reductions in the labor force. To manage crop cultivation effectively, it needs automatic monitoring in farmland. This paper presents an image-based field monitoring system for automatically crop monitoring and consists of constructing field monitoring system for periodic capturing of onion field images, training the deep neural network model for detecting the disease symptom, and evaluating performance of the developed system. The field monitoring system was composed of a PTZ camera, a motor system, wireless transceiver, and image logging module. The deep learning model was trained based on weakly supervised learning method that can classify and localize objects only with image-level annotation. It is effective to recognize crop disease symptom which has ambiguous boundary. The model was trained using captured onion images using the filed monitoring system, and 6 classes including the disease symptom were classified. The detected disease symptom was localized from background through thresholding of the class activation map. The 60% of maximum value in class activation map was determined as an Optimal threshold for disease symptom localization. Identification performance of disease symptom was evaluated using mAP metric by IoU. The results show that the mAP at IoU criteria 0.5, which should have over 50% overlap, was the highest in all models from 74.1 to 87.2. The results showed that the developed field monitoring system could automatically detect onion disease symptoms in real-time.

[1]  Maryam Rahnemoonfar,et al.  Deep Count: Fruit Counting Based on Deep Simulated Learning , 2017, Sensors.

[2]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[3]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[4]  E. R. Araújo,et al.  Weather-based decision support reduces the fungicide spraying to control onion downy mildew , 2017 .

[5]  Jeremy S. Smith,et al.  An image-processing based algorithm to automatically identify plant disease visual symptoms. , 2009 .

[6]  Amr Badr,et al.  Forecasting of nonlinear time series using ANN , 2017 .

[7]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[8]  Rasmus Nyholm Jørgensen,et al.  RoboWeedSupport - Detection of weed locations in leaf occluded cereal crops using a fully convolutional neural network , 2017 .

[9]  Martin J. Wainwright,et al.  Early stopping for non-parametric regression: An optimal data-dependent stopping rule , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[10]  S. Takeyama,et al.  Hypoglycemic activity of l-α-(3,4- dimethoxyphenethylaminomethyl)-2- hydroxybenzylalcohol 12 fumarate (TA-078) in the mouse, rat and dog , 1983 .

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  P. Lin,et al.  Prioritization of pesticides in crops with a semi-quantitative risk ranking method for Taiwan postmarket monitoring program , 2018, Journal of food and drug analysis.

[14]  Konstantinos P. Ferentinos,et al.  Deep learning models for plant disease detection and diagnosis , 2018, Comput. Electron. Agric..

[15]  Jing Liu,et al.  Image captioning with triple-attention and stack parallel LSTM , 2018, Neurocomputing.

[16]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..

[17]  Yufeng Shen,et al.  Detection of stored-grain insects using deep learning , 2018, Comput. Electron. Agric..

[18]  R. Thakur,et al.  Downy mildews of India , 2002 .

[19]  Tristan Perez,et al.  Mixtures of Lightweight Deep Convolutional Neural Networks: Applied to Agricultural Robotics , 2017, IEEE Robotics and Automation Letters.

[20]  Changshui Zhang,et al.  An In-field Automatic Wheat Disease Diagnosis System , 2017, Comput. Electron. Agric..

[21]  R. Maude.  Leaf Diseases of Onions , 2018 .

[22]  Qichao Zhang,et al.  Multi-task learning for dangerous object detection in autonomous driving , 2017, Inf. Sci..

[23]  Vijay Kumar,et al.  Counting Apples and Oranges With Deep Learning: A Data-Driven Approach , 2017, IEEE Robotics and Automation Letters.

[24]  Andreas Kamilaris,et al.  A review on the practice of big data analysis in agriculture , 2017, Comput. Electron. Agric..

[25]  Zexuan Zhu,et al.  Computational intelligence in optical remote sensing image processing , 2018, Appl. Soft Comput..

[26]  Dimitrios I. Fotiadis,et al.  Machine learning applications in cancer prognosis and prediction , 2014, Computational and structural biotechnology journal.

[27]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[28]  Radhika Dave,et al.  Extreme vulnerability of smallholder farmers to agricultural risks and climate change in Madagascar , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  David Hughes,et al.  Deep Learning for Image-Based Cassava Disease Detection , 2017, Front. Plant Sci..

[30]  Clive H. Bock,et al.  Plant Disease Severity Estimated Visually, by Digital Photography and Image Analysis, and by Hyperspectral Imaging , 2010 .

[31]  Dae H. Lee,et al.  Evaluation of operator visibility in three different cabins type Far-East combine harvesters , 2016 .

[32]  E. Survilienė,et al.  Effect of environmental conditions and inocolum concentration on sporulation of Peronospora destructor , 2006 .