Open Plant Phenotype Database of Common Weeds in Denmark

For decades, significant effort has been put into the development of plant detection and classification algorithms. However, it has been difficult to compare the performance of the different algorithms, due to the lack of a common testbed, such as a public available annotated reference dataset. In this paper, we present the Open Plant Phenotype Database (OPPD), a public dataset for plant detection and plant classification. The dataset contains 7590 RGB images of 47 plant species. Each species is cultivated under three different growth conditions, to provide a high degree of diversity in terms of visual appearance. The images are collected at the semifield area at Aarhus University, Research Centre Flakkebjerg, Denmark, using a customized data acquisition platform that provides well-illuminated images with a ground resolution of ∼6.6 px mm−1. All images are annotated with plant species using the EPPO encoding system, bounding box annotations for detection and extraction of individual plants, applied growth conditions and time passed since seeding. Additionally, the individual plants have been tracked temporally and given unique IDs. The dataset is accompanied by two experiments for: (1) plant instance detection and (2) plant species classification. The experiments introduce evaluation metrics and methods for the two tasks and provide baselines for future work on the data.

[1]  Rafael Rieder,et al.  Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review , 2018, Comput. Electron. Agric..

[2]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[3]  Rasmus Nyholm Jørgensen,et al.  Weed Growth Stage Estimator Using Deep Convolutional Neural Networks , 2018, Sensors.

[4]  Hanno Scharr,et al.  Image Analysis: The New Bottleneck in Plant Phenotyping [Applications Corner] , 2015, IEEE Signal Processing Magazine.

[5]  R. Gerhards,et al.  Practical experiences with a system for site‐specific weed control in arable crops using real‐time image analysis and GPS‐controlled patch spraying , 2006 .

[6]  Rune Hylsberg Jacobsen,et al.  Identification of High-Variation Fields based on Open Satellite Imagery , 2017 .

[7]  Kjeld Jensen,et al.  Dicotyledon Weed Quantification Algorithm for Selective Herbicide Application in Maize Crops , 2016, Sensors.

[8]  Huihui Yu,et al.  Applications of Deep Learning for Dense Scenes Analysis in Agriculture: A Review , 2020, Sensors.

[9]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Peter Norvig,et al.  The Unreasonable Effectiveness of Data , 2009, IEEE Intelligent Systems.

[11]  Bo Liu,et al.  Weed Detection for Selective Spraying: a Review , 2020, Current Robotics Reports.

[12]  Patrick Mäder,et al.  Plant Species Identification Using Computer Vision Techniques: A Systematic Literature Review , 2017, Archives of Computational Methods in Engineering.

[13]  Esmaeil S. Nadimi,et al.  Site‐specific weed control technologies , 2009 .

[14]  Biao Li,et al.  Multiscale Rotated Bounding Box-Based Deep Learning Method for Detecting Ship Targets in Remote Sensing Images , 2018, Sensors.

[15]  J. C. Price How unique are spectral signatures , 1994 .

[16]  Bernt Schiele,et al.  What Makes for Effective Detection Proposals? , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  C. Lokhorst,et al.  Proceedings of the European Conference on Agricultural Engineering AgEng2018 , 2018 .

[18]  L. Plümer,et al.  Sequential support vector machine classification for small-grain weed species discrimination with special regard to Cirsium arvense and Galium aparine , 2012 .

[19]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[20]  Scott D. Noble,et al.  Site-specific weed management: sensing requirements— what do we need to see? , 2005, Weed Science.

[21]  Jorge Torres-Sánchez,et al.  An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery , 2018, Remote. Sens..

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Mostafa Rahimi Azghadi,et al.  DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learning , 2018, Scientific Reports.

[24]  C. Hawes,et al.  Variation in Capsella (shepherd's purse): an example of intraspecific functional diversity , 2007 .

[25]  Wolfram Burgard,et al.  Agricultural robot dataset for plant classification, localization and mapping on sugar beet fields , 2017, Int. J. Robotics Res..

[26]  Bärbel Gerowitt,et al.  DSSHerbicide: Weed control in winter wheat with a decision support system in three South Baltic regions – Field experimental results , 2015 .

[27]  Hanno Scharr,et al.  Finely-grained annotated datasets for image-based plant phenotyping , 2016, Pattern Recognit. Lett..

[28]  Weiming He,et al.  The relative contributions of climate, soil, diversity and interactions to leaf trait variation and spectrum of invasive Solidago canadensis , 2019, BMC Ecology.

[29]  David C. Slaughter,et al.  Autonomous robotic weed control systems: A review , 2008 .

[30]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[31]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  S. Fennimore,et al.  Robotic weeders can improve weed control options for specialty crops. , 2019, Pest management science.

[33]  Jorge Torres-Sánchez,et al.  Quantifying Efficacy and Limits of Unmanned Aerial Vehicle (UAV) Technology for Weed Seedling Detection as Affected by Sensor Resolution , 2015, Sensors.

[34]  Cyrill Stachniss,et al.  Robust joint stem detection and crop‐weed classification using image sequences for plant‐specific treatment in precision farming , 2019, J. Field Robotics.