Automatic Plant Cover Estimation with Convolutional Neural Networks

Monitoring the responses of plants to environmental changes is essential for plant biodiversity research. This, however, is currently still being done manually by botanists in the field. This work is very laborious, and the data obtained is, though following a standardized method to estimate plant coverage, usually subjective and has a coarse temporal resolution. To remedy these caveats, we investigate approaches using convolutional neural networks (CNNs) to automatically extract the relevant data from images, focusing on plant community composition and species coverages of 9 herbaceous plant species. To this end, we investigate several standard CNN architectures and different pretraining methods. We find that we outperform our previous approach at higher image resolutions using a custom CNN with a mean absolute error of 5.16%. In addition to these investigations, we also conduct an error analysis based on the temporal aspect of the plant cover images. This analysis gives insight into where problems for automatic approaches lie, like occlusion and likely misclassifications caused by temporal changes.

[1]  Joel A. Granados,et al.  Using phenocams to monitor our changing Earth: toward a global phenocam network , 2016 .

[2]  A. Fitter,et al.  Rapid Changes in Flowering Time in British Plants , 2002, Science.

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  P. Reich,et al.  Shifting plant species composition in response to climate change stabilizes grassland primary production , 2018, Proceedings of the National Academy of Sciences.

[6]  S. Cousins,et al.  Landscape structure and land use history influence changes in island plant composition after 100 years , 2012 .

[7]  J. Peñuelas,et al.  European phenological response to climate change matches the warming pattern , 2006 .

[8]  Joachim Denzler,et al.  Towards Confirmable Automated Plant Cover Determination , 2020, ECCV Workshops.

[9]  Forrest N. Iandola,et al.  DenseNet: Implementing Efficient ConvNet Descriptor Pyramids , 2014, ArXiv.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Zhiguo Cao,et al.  TasselNet: counting maize tassels in the wild via local counts regression network , 2017, Plant Methods.

[12]  Yang Song,et al.  The iNaturalist Species Classification and Detection Dataset , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Jitendra Malik,et al.  Amodal Instance Segmentation , 2016, ECCV.

[14]  Sebastian Schmidtlein,et al.  Convolutional Neural Networks accurately predict cover fractions of plant species and communities in Unmanned Aerial Vehicle imagery , 2020, Remote Sensing in Ecology and Conservation.

[15]  M. Estiarte,et al.  Plant community changes induced by experimental climate change: Seedling and adult species composition , 2009 .

[16]  N. Eisenhauer,et al.  From climate chambers to biodiversity chambers , 2018 .

[17]  Anne D. Bjorkman,et al.  Global trait–environment relationships of plant communities , 2018, Nature Ecology & Evolution.

[18]  Siddhartha S. Mehta,et al.  Deep Orange: Mask R-CNN based Orange Detection and Segmentation , 2019, IFAC-PapersOnLine.

[19]  Hulya Yalcin,et al.  Plant classification using convolutional neural networks , 2016, 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics).

[20]  Yang Song,et al.  Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Hao Lu,et al.  TasselNetv2: in-field counting of wheat spikes with context-augmented local regression networks , 2019, Plant Methods.

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Paolo Remagnino,et al.  Deep-plant: Plant identification with convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[25]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[26]  Ben C. Stöver,et al.  LeafNet: A computer vision system for automatic plant species identification , 2017, Ecol. Informatics.

[27]  N. Sanders,et al.  Bottom–up and top–down effects on plant communities: nutrients limit productivity, but insects determine diversity and composition , 2016 .

[28]  Jenica M. Allen,et al.  Phenological tracking enables positive species responses to climate change. , 2012, Ecology.

[29]  Yaser Ahangari Nanehkaran,et al.  Using deep transfer learning for image-based plant disease identification , 2020, Comput. Electron. Agric..

[30]  Cynthia Rosenzweig,et al.  Assessment of observed changes and responses in natural and managed systems , 2007 .

[31]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[32]  Richard B Primack,et al.  Global warming and flowering times in Thoreau's Concord: a community perspective. , 2008, Ecology.

[33]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  S. Klotz,et al.  Multitrophische Biodiversitätsmanipulation unter kontrollierten Umweltbedingungen im iDiv Ecotron , 2017 .

[36]  M. Migliavacca,et al.  Traits and climate are associated with first flowering day in herbaceous species along elevational gradients , 2017, Ecology and evolution.

[37]  M. Lange,et al.  Invertebrate Decline Leads to Shifts in Plant Species Abundance and Phenology , 2020, Frontiers in Plant Science.

[38]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[39]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.