Nondestructive Determination of Nitrogen, Phosphorus and Potassium Contents in Greenhouse Tomato Plants Based on Multispectral Three-Dimensional Imaging

Measurement of plant nitrogen (N), phosphorus (P), and potassium (K) levels are important for determining precise fertilization management approaches for crops cultivated in greenhouses. To accurately, rapidly, stably, and nondestructively measure the NPK levels in tomato plants, a nondestructive determination method based on multispectral three-dimensional (3D) imaging was proposed. Multiview RGB-D images and multispectral images were synchronously collected, and the plant multispectral reflectance was registered to the depth coordinates according to Fourier transform principles. Based on the Kinect sensor pose estimation and self-calibration, the unified transformation of the multiview point cloud coordinate system was realized. Finally, the iterative closest point (ICP) algorithm was used for the precise registration of multiview point clouds and the reconstruction of plant multispectral 3D point cloud models. Using the normalized grayscale similarity coefficient, the degree of spectral overlap, and the Hausdorff distance set, the accuracy of the reconstructed multispectral 3D point clouds was quantitatively evaluated, the average value was 0.9116, 0.9343 and 0.41 cm, respectively. The results indicated that the multispectral reflectance could be registered to the Kinect depth coordinates accurately based on the Fourier transform principles, the reconstruction accuracy of the multispectral 3D point cloud model met the model reconstruction needs of tomato plants. Using back-propagation artificial neural network (BPANN), support vector machine regression (SVMR), and gaussian process regression (GPR) methods, determination models for the NPK contents in tomato plants based on the reflectance characteristics of plant multispectral 3D point cloud models were separately constructed. The relative error (RE) of the N content by BPANN, SVMR and GPR prediction models were 2.27%, 7.46% and 4.03%, respectively. The RE of the P content by BPANN, SVMR and GPR prediction models were 3.32%, 8.92% and 8.41%, respectively. The RE of the K content by BPANN, SVMR and GPR prediction models were 3.27%, 5.73% and 3.32%, respectively. These models provided highly efficient and accurate measurements of the NPK contents in tomato plants. The NPK contents determination performance of these models were more stable than those of single-view models.

[1]  Kong Wenwen,et al.  Critical review of fast detection of crop nutrient and physiological information with spectral and imaging technology. , 2015 .

[2]  Mao Hanping,et al.  Diagnosis and detection of phosphorus nutrition level for Solanum lycopersicum based on electrical impedance spectroscopy , 2016 .

[3]  Wenjiang Huang,et al.  Off-Nadir Hyperspectral Sensing for Estimation of Vertical Profile of Leaf Chlorophyll Content within Wheat Canopies , 2017, Sensors.

[4]  Daniela de Carvalho Lopes,et al.  Vis/NIR spectroscopy and chemometrics for non-destructive estimation of water and chlorophyll status in sunflower leaves , 2017 .

[5]  Federico Pallottino,et al.  Nitrogen Concentration Estimation in Tomato Leaves by VIS-NIR Non-Destructive Spectroscopy , 2011, Sensors.

[6]  Francisco M. Padilla,et al.  The Use of Chlorophyll Meters to Assess Crop N Status and Derivation of Sufficiency Values for Sweet Pepper , 2019, Sensors.

[7]  Jörg Peter Baresel,et al.  Use of a digital camera as alternative method for non-destructive detection of the leaf chlorophyll content and the nitrogen nutrition status in wheat , 2017, Comput. Electron. Agric..

[8]  Jan Kuckenberg,et al.  Detection and differentiation of nitrogen-deficiency, powdery mildew and leaf rust at wheat leaf and canopy level by laser-induced chlorophyll fluorescence , 2009 .

[9]  Étienne Belin,et al.  Recent Applications of Multispectral Imaging in Seed Phenotyping and Quality Monitoring—An Overview , 2019, Sensors.

[10]  Avinash Agarwal,et al.  Assessment of spinach seedling health status and chlorophyll content by multivariate data analysis and multiple linear regression of leaf image features , 2018, Comput. Electron. Agric..

[11]  Guoxiang Sun,et al.  Three-Dimensional Point Cloud Reconstruction and Morphology Measurement Method for Greenhouse Plants Based on the Kinect Sensor Self-Calibration , 2019, Agronomy.

[12]  Minzan Li,et al.  Development of an optical sensor for crop leaf chlorophyll content detection , 2009 .

[13]  Robin Gebbers,et al.  Assessing Nitrogen and water status of winter wheat using a digital camera , 2019, Comput. Electron. Agric..

[14]  Fumiki Hosoi,et al.  Three-Dimensional Monitoring of Plant Structural Parameters and Chlorophyll Distribution , 2019, Sensors.

[15]  Yu Lei,et al.  Early Visual Detection of Wheat Stripe Rust Using Visible/Near-Infrared Hyperspectral Imaging , 2019, Sensors.

[16]  Yufeng Ge,et al.  Temporal dynamics of maize plant growth, water use, and leaf water content using automated high throughput RGB and hyperspectral imaging , 2016, Comput. Electron. Agric..

[17]  Fei Liu,et al.  Detecting macronutrients content and distribution in oilseed rape leaves based on hyperspectral imaging , 2013 .

[18]  Jun Ni,et al.  Development of an Apparatus for Crop-Growth Monitoring and Diagnosis , 2018, Sensors.

[19]  José Dorado,et al.  Three-Dimensional Modeling of Weed Plants Using Low-Cost Photogrammetry , 2018, Sensors.

[20]  Tao Wang,et al.  Fast Detection of Striped Stem-Borer (Chilo suppressalis Walker) Infested Rice Seedling Based on Visible/Near-Infrared Hyperspectral Imaging System , 2017, Sensors.

[21]  David Reiser,et al.  3-D reconstruction of maize plants using a time-of-flight camera , 2018, Comput. Electron. Agric..

[22]  Zhe Zhang,et al.  Hyperspectral Imaging for the Nondestructive Quality Assessment of the Firmness of Nanguo Pears Under Different Freezing/Thawing Conditions , 2019, Sensors.

[23]  Qin Zhang,et al.  A Review of Imaging Techniques for Plant Phenotyping , 2014, Sensors.

[24]  Yu Zhang,et al.  Estimating 3D Leaf and Stem Shape of Nursery Paprika Plants by a Novel Multi-Camera Photography System , 2016, Sensors.

[25]  Jayme Garcia Arnal Barbedo,et al.  Detection of nutrition deficiencies in plants using proximal images and machine learning: A review , 2019, Comput. Electron. Agric..

[26]  Chu Zhang,et al.  Application of Hyperspectral Imaging to Detect Sclerotinia sclerotiorum on Oilseed Rape Stems , 2018, Sensors.

[27]  Dongjian He,et al.  Early Visual Detection of Wheat Stripe Rust Using Visible/Near-Infrared Hyperspectral Imaging , 2019, Sensors.

[28]  Yufeng Ge,et al.  A Novel LiDAR-Based Instrument for High-Throughput, 3D Measurement of Morphological Traits in Maize and Sorghum , 2018, Sensors.

[29]  Francisco M. Padilla,et al.  Proximal Optical Sensors for Nitrogen Management of Vegetable Crops: A Review , 2018, Sensors.

[30]  Zhu Wenjing,et al.  Diagnosis of potassium nutrition level in Solanum lycopersicum based on electrical impedance , 2016 .

[31]  Anne-Katrin Mahlein,et al.  Comparison and Combination of Thermal, Fluorescence, and Hyperspectral Imaging for Monitoring Fusarium Head Blight of Wheat on Spikelet Scale , 2019, Sensors.

[32]  Paul Scheunders,et al.  Close range hyperspectral imaging of plants: A review , 2017 .

[33]  Zhang Changli,et al.  Prediction for nitrogen content of rice leaves in cold regionbased on hyperspectrum , 2016 .

[34]  Guoxiang Sun,et al.  Measurement Method Based on Multispectral Three-Dimensional Imaging for the Chlorophyll Contents of Greenhouse Tomato Plants , 2019, Sensors.

[35]  O. Bruno,et al.  Use of artificial vision techniques for diagnostic of nitrogen nutritional status in maize plants , 2014 .

[36]  Kenji Omasa,et al.  Estimating rice chlorophyll content and leaf nitrogen concentration with a digital still color camera under natural light , 2014, Plant Methods.

[37]  Xuezhi Yue,et al.  ASD Field Spec3野外便携式高光谱仪诊断冬小麦氮营养 , 2018 .

[38]  Michael Henke,et al.  Automated Alignment of Multi-Modal Plant Images Using Integrative Phase Correlation Approach , 2018, Front. Plant Sci..