Identification of Plant Nutrient Deficiencies Using Convolutional Neural Networks

A novel image analysis method for identifying nutrient deficiencies in plant based on its leaf is proposed. First, the proposed method divides an input leaf image into small blocks. Second, each block of leaf pixels is fed to a set of convolutional neural networks (CNNs). Each CNN is specifically trained for a nutrient deficiency and is utilized to decide if a block is presenting any symptom of the corresponding nutrient deficiency. Next, the responses from all CNNs are integrated to produce a single response for the block using a winner-take-all strategy. Finally, the responses from all blocks are integrated into one using a multi-layer perceptron to produce a final response for the whole leaf. Validation of the proposed method was performed on a set of black gram (Vigna mungo) plants grown under nutrient-controlled environments. Five types of deficiencies, i.e., Ca, Fe, K, Mg, and N deficiencies, and a group of plants with complete nutrients were studied. A dataset consisting of 3,000 leaf images was collected and used for experimentation. Experimental results indicate the superiority of the proposed method over trained humans in nutrient deficiency identification.

[1]  O. Bruno,et al.  Use of artificial vision techniques for diagnostic of nitrogen nutritional status in maize plants , 2014 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  C. Glasbey,et al.  Automatic fruit recognition and counting from multiple images , 2014 .

[4]  Zou Xiaobo,et al.  Nondestructive diagnostics of nitrogen deficiency by cucumber leaf chlorophyll distribution map based on near infrared hyperspectral imaging , 2012 .

[5]  Sang-Heon Lee,et al.  Review on fruit harvesting method for potential use of automatic fruit harvesting systems , 2011 .

[6]  Ali Akoglu,et al.  Original paper: Lettuce calcium deficiency detection with machine vision computed plant features in controlled environments , 2010 .

[7]  Y. Wang,et al.  Estimating nitrogen status of rice using the image segmentation of G-R thresholding method , 2013 .

[8]  Wei Wu,et al.  Detection of aphids in wheat fields using a computer vision technique , 2016 .

[9]  Noboru Ohnishi,et al.  Computer vision based methods for detecting weeds in lawns , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[10]  J. Hemming,et al.  PA—Precision Agriculture: Computer-Vision-based Weed Identification under Field Conditions using Controlled Lighting , 2001 .

[11]  Paolo Remagnino,et al.  Plant species identification using digital morphometrics: A review , 2012, Expert Syst. Appl..

[12]  Jeremy S. Smith,et al.  An image-processing based algorithm to automatically identify plant disease visual symptoms. , 2009 .

[13]  Q. Zhang,et al.  Sensors and systems for fruit detection and localization: A review , 2015, Comput. Electron. Agric..

[14]  Ukrit Watchareeruetai,et al.  Separation of abnormal regions on black gram leaves using image analysis , 2017, 2017 14th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[15]  Yongqiang Ye,et al.  Use of leaf color images to identify nitrogen and potassium deficient tomatoes , 2011, Pattern Recognit. Lett..

[16]  Reza Ehsani,et al.  Review: A review of advanced techniques for detecting plant diseases , 2010 .

[17]  Noboru Ohnishi,et al.  A New Color-based Lawn Weed Detection Method and Its Integration with Texture-based Methods: A Hybrid Approach , 2011 .

[18]  Jayme Garcia Arnal Barbedo,et al.  Using digital image processing for counting whiteflies on soybean leaves , 2014 .