Automatic image-based detection technology for two critical growth stages of maize: Emergence and three-leaf stage

Growth stage information of field crops is not only an important basic data for analyzing the relationship between the crop growth process and the agrometeorological conditions, but it is also useful for various aspects of precision agriculture. Up to now, it is primarily obtained manually, which is time-consuming, labor-intensive, subjective and discontinuous. Therefore, a noninvasive method to note observations that also proves to be more efficient, continuous, and automatic is needed. At present, an alternative method based on computer vision has been widely used for monitoring crop growth status due to advantages linked to its low-cost, its intuitiveness and non-contact manner of data gathering it provides. However, little research has been done to improve close observation of different growth stages of field crops using digital cameras. To overcome the drawbacks caused by the current manual observation, a study was conducted to explore the application of computer vision technology for the automatic detection technology of two critical growth stages of maize (emergence and three-leaf stage). In order to identify the growth stages, the first task is to extract the plants from images properly. According to complex factors on farm fields, we proposed a novel crops segmentation method (AP-HI) which is robust and not sensitive to the challenging variation of outdoor luminosity and complex environmental elements. It has laid the foundation for subsequent studies. By virtue of the AP-HI, two automatic detection methods based on imaging were investigated for the two critical growth stages of maize. The former method uses the spatial distribution feature to judge accurately whether the field crop has reached the emergence stage or not. The latter uses the skeleton endpoint to characterize the leaf of seedling and transforms a matter of judgment into that of probability estimation, which leads to the final conclusion. In order to verify the feasibility and validity of our proposed methods, the comparing experiments have been carried out. Five well-established algorithms were utilized to make comparison with AP-HI and its results showed that our method outperformed the other algorithms in yielding the highest performance of 96.68% with the lowest standard deviation of 2.37%. As for the two automatic detection methods, the crops of two experimental fields located in Zhengzhou, Henan and Taian, Shandong provinces in China were observed both with a human observer and by using automated routines to process images obtained from a camera. In determining the time at which a growth stage occurred, the proposed methods produced the similar results to the manual observation method. Overall, the automated methods can meet the demand for practical observation needed for agronomic modeling and in triggering action alerts to farmers.

[1]  Xavier P. Burgos-Artizzu,et al.  utomatic segmentation of relevant textures in agricultural images , 2010 .

[2]  Min C. Shin,et al.  Effect of colorspace transformation, the illuminance component, and color modeling on skin detection , 2004, CVPR 2004.

[3]  Serge Beucher Digital skeletons in Euclidean and geodesic spaces , 1994, Signal Process..

[4]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Alberto Tellaeche,et al.  A vision-based method for weeds identification through the Bayesian decision theory , 2008, Pattern Recognit..

[6]  Hiroyuki Shimono,et al.  Effect of high water temperature during vegetative growth on rice growth and yield under a cool climate , 2011 .

[7]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[8]  N. D. Tillett,et al.  Automated Crop and Weed Monitoring in Widely Spaced Cereals , 2006, Precision Agriculture.

[9]  Björn Åstrand,et al.  Classification of crops and weeds extracted by active shape models , 2008 .

[10]  Chenghai Yang,et al.  Comparison of QuickBird Satellite Imagery and Airborne Imagery for Mapping Grain Sorghum Yield Patterns , 2006, Precision Agriculture.

[11]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  N. Zhang,et al.  Precision agriculture—a worldwide overview , 2002 .

[13]  Lei Tian,et al.  An automated stand-alone in-field remote sensing system (SIRSS) for in-season crop monitoring , 2011 .

[14]  Erin E. Blankenship,et al.  Critical period for weed control: the concept and data analysis , 2002, Weed Science.

[15]  T. Kataoka,et al.  Crop growth estimation system using machine vision , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[16]  Zhenghong Yu,et al.  Automatic measurement of crops canopy height based on monocular vision , 2011, International Symposium on Multispectral Image Processing and Pattern Recognition.

[17]  Mohammad Bannayan,et al.  Weather conditions associated with irrigated crops in an arid and semi arid environment , 2011 .

[18]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[19]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[20]  Robin Gebbers,et al.  Precision Agriculture and Food Security , 2010, Science.

[21]  Kelly R. Thorp,et al.  Color image segmentation approach to monitor flowering in lesquerella , 2011 .

[22]  C. Daughtry,et al.  Evaluation of Digital Photography from Model Aircraft for Remote Sensing of Crop Biomass and Nitrogen Status , 2005, Precision Agriculture.

[23]  Cristian Flueraru,et al.  A Validation of MODIS Snowcover Products in Romania: Challenges and Future Directions , 2007, Trans. GIS.

[24]  Jaime Gomez-Gil,et al.  Testing different color spaces based on hue for the environmentally adaptive segmentation algorithm (EASA) , 2009 .

[25]  J. Hanway How a corn plant develops , 1966 .

[26]  Andrew E. Suyker,et al.  An alternative method using digital cameras for continuous monitoring of crop status , 2012 .

[27]  Yantai Gan,et al.  Phenological trends in winter wheat and spring cotton in response to climate changes in northwest China , 2008 .

[28]  Charlie Walker,et al.  Estimating the nitrogen status of crops using a digital camera , 2010 .

[29]  Paul A. Counce,et al.  A Uniform, Objective, and Adaptive System for Expressing Rice Development , 2000 .

[30]  Kohzo Homma,et al.  Daytime and Nighttime Field Spectral Imagery of Ripening Paddy Rice for Determining Leaf Greenness and 1000-Grain Weight , 2009 .

[31]  Jiwang Zhang,et al.  Root growth, available soil water, and water-use efficiency of winter wheat under different irrigation regimes applied at different growth stages in North China , 2010 .

[32]  J. C. Neto,et al.  A combined statistical-soft computing approach for classification and mapping weed species in minimum -tillage systems , 2004 .

[33]  Zhiguo Cao,et al.  Type-2 fuzzy thresholding using GLSC histogram of human visual nonlinearity characteristics. , 2011, Optics express.

[34]  Takeshi Motohka,et al.  Applicability of Green-Red Vegetation Index for Remote Sensing of Vegetation Phenology , 2010, Remote. Sens..

[35]  Raphael Linker,et al.  Determination of the number of green apples in RGB images recorded in orchards , 2012 .

[36]  Chiho Kim,et al.  Color segmentation robust to brightness variations by using B-spline curve modeling , 2008, Pattern Recognit..

[37]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[38]  F. Cointault,et al.  In‐field Triticum aestivum ear counting using colour‐texture image analysis , 2008 .

[39]  Royal D. Heins,et al.  Computer-Vision-Based System for Plant Growth Analysis , 1995 .

[40]  Lei Tian,et al.  Environmentally adaptive segmentation algorithm for outdoor image segmentation , 1998 .

[41]  Cecilia Di Ruberto Recognition of shapes by attributed skeletal graphs , 2004, Pattern Recognit..

[42]  D. G. Westfall,et al.  Normalized Difference Vegetation Index and Soil Color‐Based Management Zones in Irrigated Maize , 2008 .

[43]  Daming Shi,et al.  Segmentation of green vegetation of crop canopy images based on mean shift and Fisher linear discriminant , 2010, Pattern Recognit. Lett..

[44]  Elizabeth Pattey,et al.  Retrieval of leaf area index from top-of-canopy digital photography over agricultural crops , 2010 .

[45]  Andrew E. Suyker,et al.  A Two-Step Filtering approach for detecting maize and soybean phenology with time-series MODIS data , 2010 .

[46]  Gilles Rabatel,et al.  Potential of field hyperspectral imaging as a non destructive method to assess leaf nitrogen content in Wheat , 2011 .