Global Wheat Head Detection (GWHD) Dataset: A Large and Diverse Dataset of High-Resolution RGB-Labelled Images to Develop and Benchmark Wheat Head Detection Methods

The detection of wheat heads in plant images is an important task for estimating pertinent wheat traits including head population density and head characteristics such as health, size, maturity stage, and the presence of awns. Several studies have developed methods for wheat head detection from high-resolution RGB imagery based on machine learning algorithms. However, these methods have generally been calibrated and validated on limited datasets. High variability in observational conditions, genotypic differences, development stages, and head orientation makes wheat head detection a challenge for computer vision. Further, possible blurring due to motion or wind and overlap between heads for dense populations make this task even more complex. Through a joint international collaborative effort, we have built a large, diverse, and well-labelled dataset of wheat images, called the Global Wheat Head Detection (GWHD) dataset. It contains 4700 high-resolution RGB images and 190000 labelled wheat heads collected from several countries around the world at different growth stages with a wide range of genotypes. Guidelines for image acquisition, associating minimum metadata to respect FAIR principles, and consistent head labelling methods are proposed when developing new head detection datasets. The GWHD dataset is publicly available at http://www.global-wheat.com/and aimed at developing and benchmarking methods for wheat head detection.

[1]  N. E. Borlaug,et al.  Applying innovations and new technologies for international collaborative wheat improvement , 2006, The Journal of Agricultural Science.

[2]  David Gouache,et al.  Why are wheat yields stagnating in Europe? A comprehensive data analysis for France , 2010 .

[3]  Hanno Scharr,et al.  Annotated Image Datasets of Rosette Plants , 2014 .

[4]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Luiz Eduardo Soares de Oliveira,et al.  PKLot - A robust dataset for parking lot classification , 2015, Expert Syst. Appl..

[8]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.

[9]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[10]  Uwe Scholz,et al.  Measures for interoperability of phenotypic data: minimum information requirements and formatting , 2016, Plant Methods.

[11]  Tony P. Pridmore,et al.  Deep Learning for Multitask Plant Phenotyping , 2017 .

[12]  Ian Stavness,et al.  Deep Plant Phenomics: A Deep Learning Platform for Complex Plant Phenotyping Tasks , 2017, Front. Plant Sci..

[13]  Atsushi Shimada,et al.  An Easy-to-Setup 3D Phenotyping Platform for KOMATSUNA Dataset , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[14]  Winston H. Hsu,et al.  Drone-Based Object Counting by Spatially Regularized Regional Proposal Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Tony P. Pridmore,et al.  Deep Learning for Multi-task Plant Phenotyping , 2017, bioRxiv.

[16]  Silvio Savarese,et al.  Subcategory-Aware Convolutional Neural Networks for Object Proposals and Detection , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[17]  Ashutosh Kumar Singh,et al.  Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives. , 2018, Trends in plant science.

[18]  Przemyslaw Prusinkiewicz,et al.  The use of plant models in deep learning: an application to leaf counting in rosette plants , 2018, Plant Methods.

[19]  Cyrill Stachniss,et al.  WeedMap: A large-scale semantic weed mapping framework using aerial multispectral imaging and deep neural network for precision farming , 2018, Remote. Sens..

[20]  Rasmus Nyholm Jørgensen,et al.  Weed Growth Stage Estimator Using Deep Convolutional Neural Networks , 2018, Sensors.

[21]  Cyrill Stachniss,et al.  Real-Time Semantic Segmentation of Crop and Weed for Precision Agriculture Robots Leveraging Background Knowledge in CNNs , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Hamid Laga,et al.  Detection and analysis of wheat spikes using Convolutional Neural Networks , 2018, Plant Methods.

[23]  Philippe Ciais,et al.  Yield trends, variability and stagnation analysis of major crops in France over more than a century , 2018, Scientific Reports.

[24]  Wei Guo,et al.  Aerial Imagery Analysis – Quantifying Appearance and Number of Sorghum Heads for Applications in Breeding and Agronomy , 2018, Front. Plant Sci..

[25]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[26]  Suchismita Mondal,et al.  Combining High‐Throughput Phenotyping and Genomic Information to Increase Prediction and Selection Accuracy in Wheat Breeding , 2018, The plant genome.

[27]  Tal Hassner,et al.  Precise Detection in Densely Packed Scenes , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Anders Krogh Mortensen,et al.  The GrassClover Image Dataset for Semantic and Hierarchical Species Understanding in Agriculture , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Frédéric Baret,et al.  Ear density estimation from high resolution RGB imagery using deep learning technique , 2019, Agricultural and Forest Meteorology.

[30]  Shubhra Aich,et al.  Object Counting with Small Datasets of Large Images , 2018, ArXiv.

[31]  Hao Lu,et al.  TasselNetv2: in-field counting of wheat spikes with context-augmented local regression networks , 2019, Plant Methods.

[32]  Hao Lu,et al.  From Open Set to Closed Set: Counting Objects by Spatial Divide-and-Conquer , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[33]  Elizabeth Arnaud,et al.  Applying FAIR Principles to Plant Phenotypic Data Management in GnpIS , 2019, Plant phenomics.

[34]  F. Baret,et al.  High-Throughput Measurements of Stem Characteristics to Estimate Ear Density and Above-Ground Biomass , 2019, Plant phenomics.

[35]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[36]  Michael P. Pound,et al.  Recovering Wind-Induced Plant Motion in Dense Field Environments via Deep Learning and Multiple Object Tracking1[CC-BY] , 2019, Plant Physiology.

[37]  Achim Walter,et al.  Spectral Vegetation Indices to Track Senescence Dynamics in Diverse Wheat Germplasm , 2020, Frontiers in Plant Science.

[38]  Pouria Sadeghi-Tehran,et al.  DeepCount: In-Field Automatic Quantification of Wheat Spikes Using Simple Linear Iterative Clustering and Deep Convolutional Neural Networks , 2019, Front. Plant Sci..

[39]  Baskar Ganapathysubramanian,et al.  A Weakly Supervised Deep Learning Framework for Sorghum Head Detection and Counting , 2019, Plant phenomics.

[40]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[41]  Volkan Isler,et al.  MinneApple: A Benchmark Dataset for Apple Detection and Segmentation , 2019, IEEE Robotics and Automation Letters.

[42]  Jordi Pont-Tuset,et al.  The Open Images Dataset V4 , 2018, International Journal of Computer Vision.

[43]  S. Chapman,et al.  Breeder friendly phenotyping. , 2020, Plant science : an international journal of experimental plant biology.