Fine-grained maize tassel trait characterization with multi-view representations

Display Omitted A novel pipeline is proposed for efficient tassel potential region extraction.We proposed to characterize the maize tassel with a multi-view mechanism.Effective tassel detection is performed for fine-grained trait characterization.Time-series monitoring is executed to acquire tassel trait growing parameters.We have established a relatively large-scale maize tassel dataset. The characteristics of maize tassel trait are important cues to improve the farming operation for production enhancement. Currently, the information obtained from the maize tassel mainly depends on human labor, which is subjective and labor-intensive. Recent researches have introduced several image-based approaches to overcome the shortage with a modest degree of success. However, due to the variation of cultivar, pose and illumination, and the clustered background, characterizing the maize tassel trait with computer vision remains a challenging problem. To this end, an automatic fine-grained machine vision system termed mTASSEL is developed in this paper. We proposed to characterize the maize tassel with multi-view representations that combine multiple feature views and different channel views, which can alleviate the influence of environmental variations. In addition to the total tassel number trait, some fine-grained tassel traits, including the tassel color, branch number, length, width, perimeter and diameter, are further characterized to execute the time-series monitoring. To boost the related research, a relatively large-scale maize tassel dataset (10 sequences with 16,031 samples) is first constructed by our team. The experimental results demonstrate that both system modules significantly outperform other state-of-the-art approaches by large margins (26.0% for the detection and 7.8% for the segmentation). Results of this research can serve the automatic growth stage detection, accurate yield estimation and machine detasseling, as well as the field-based phenotyping research. The dataset and source code of the system are available online.

[1]  Nguyen Van Hoa,et al.  Visualization of the growth process of pruned and trained citrus trees for appropriate cultivation , 2014, SIGGRAPH ASIA Posters.

[2]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[4]  Yu Qiao,et al.  Large Margin Dimensionality Reduction for Action Similarity Labeling , 2014, IEEE Signal Processing Letters.

[5]  Wei Guo,et al.  Illumination invariant segmentation of vegetation for time series wheat images based on decision tree model , 2013 .

[6]  Zhenghong Yu,et al.  An image-based approach for automatic detecting five true-leaves stage of cotton , 2013, Other Conferences.

[7]  Andrew Zisserman,et al.  Fisher Vector Faces in the Wild , 2013, BMVC.

[8]  Zhiguo Cao,et al.  Type-2 fuzzy thresholding using GLSC histogram of human visual nonlinearity characteristics. , 2011, Optics express.

[9]  Katsushi Ikeuchi,et al.  Illumination invariant segmentation of spatio-temporal images by spatio-temporal Markov random field model , 2002, Object recognition supported by user interaction for service robots.

[10]  Roland Vencovsky,et al.  Estimates of genetic parameters for tosses characters in maize ( zea mays l ) and breeding respectives , 1985 .

[11]  S. Ninomiya,et al.  Automated characterization of flowering dynamics in rice using field-acquired time-series RGB images , 2015, Plant Methods.

[12]  Zhenghong Yu,et al.  Automatic image-based detection technology for two critical growth stages of maize: Emergence and three-leaf stage , 2013 .

[13]  Sanjiv Singh,et al.  Automated Visual Yield Estimation in Vineyards , 2014, J. Field Robotics.

[14]  Zhenghong Yu,et al.  An image-based approach for automatic detecting tasseling stage of maize using spatio-temporal saliency , 2013, Other Conferences.

[15]  Dorian Q. Fuller,et al.  The nature of selection during plant domestication , 2009, Nature.

[16]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[17]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Daren Yu,et al.  Large Margin Dimensionality Reduction for Time Series , 2010, 2010 First International Conference on Pervasive Computing, Signal Processing and Applications.

[20]  Rodomiro Ortiz,et al.  Phenotypic diversity for morphological and agronomic characteristics in chickpea core collection , 2002, Euphytica.

[21]  Andrew Zisserman,et al.  The devil is in the details: an evaluation of recent feature encoding methods , 2011, BMVC.

[22]  Won Suk Lee,et al.  Green citrus detection using 'eigenfruit', color and circular Gabor texture features under natural outdoor conditions , 2011 .

[23]  Jiwang Zhang,et al.  Root growth, available soil water, and water-use efficiency of winter wheat under different irrigation regimes applied at different growth stages in North China , 2010 .

[24]  A. Molina,et al.  Genetic Diversity in Cultivated Common Bean: II. Marker‐Based Analysis of Morphological and Agronomic Traits , 1991 .

[25]  Mark W. Schmidt,et al.  A Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets , 2012, NIPS.

[26]  Achim Walter,et al.  Remote, aerial phenotyping of maize traits with a mobile multi-sensor approach , 2015, Plant Methods.

[27]  Erin E. Blankenship,et al.  Critical period for weed control: the concept and data analysis , 2002, Weed Science.

[28]  Marcel Tresanchez,et al.  Definition of Linear Color Models in the RGB Vector Color Space to Detect Red Peaches in Orchard Images Taken under Natural Illumination , 2012, Sensors.

[29]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hilla Peretz,et al.  The , 1966 .

[31]  Thomas Deselaers,et al.  What is an object? , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Robin Gebbers,et al.  Precision Agriculture and Food Security , 2010, Science.

[33]  Mansour Ebrahimi,et al.  Determining the Most Important Physiological and Agronomic Traits Contributing to Maize Grain Yield through Machine Learning Algorithms: A New Avenue in Intelligent Agriculture , 2014, PloS one.

[34]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[35]  Ismail Kavdir,et al.  Detecting corn tassels using computer vision and support vector machines , 2014, Expert Syst. Appl..

[36]  L. Xiong,et al.  Combining high-throughput phenotyping and genome-wide association studies to reveal natural genetic variation in rice , 2014, Nature Communications.

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Jianxin Wu,et al.  mCENTRIST: A Multi-Channel Feature Generation Mechanism for Scene Categorization , 2014, IEEE Transactions on Image Processing.

[39]  R. J. Lambert,et al.  Leaf Angle, Tassel Morphology, and the Performance of Maize Hybrids1 , 1978 .

[40]  J. Woolliams,et al.  What is Genetic Diversity , 2007 .

[41]  Minzan Li,et al.  Corn tassel detection based on image processing , 2011, International Workshop on Image Processing and Optical Engineering.

[42]  Cristian Sminchisescu,et al.  Semantic Segmentation with Second-Order Pooling , 2012, ECCV.

[43]  Cecilia Di Ruberto,et al.  Recognition of shapes by attributed skeletal graphs , 2004, Pattern Recognit..

[44]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[45]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[46]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[47]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[48]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[49]  Gonzalo Pajares,et al.  Automatic detection of crop rows in maize fields with high weeds pressure , 2012, Expert Syst. Appl..

[50]  Friedhelm Schwenker,et al.  Ensemble Methods: Foundations and Algorithms [Book Review] , 2013, IEEE Computational Intelligence Magazine.