Plant phenology recognition using deep learning: Deep-Pheno

Monitoring phenology of agricultural plants is a critical understanding in precision agriculture. Vital improvements can be achieved with precise detection of phenological change of plants which would henceforth improve the timing for the harvest, pest control, yield prediction, farm monitoring, disaster warning etc. Many countries across the world have been developing initiatives to build national agriculture monitoring network systems, since inferring the phenological information contributes to a better understanding of relationships between productivity, vegetation health and environmental conditions. In this paper, we utilize a deep learning architecture to recognize and classify phenological stages of several types of plants purely based on the visual data captured every half an hour by cameras mounted on the ground agro-stations that have been planted all over Turkey as part of an agriculture monitoring network system. A pre-trained Convolutional Neural Network architecture (CNN) is employed to automatically extract the features of images. In order to evaluate the performance of the approach proposed in this paper, the results obtained through CNN model are compared with those obtained by employing hand crafted feature descriptors. Experimental results suggest that CNN architecture outperforms the machine learning algorithms based on hand crafted features for the discrimination of phenological stages.

[1]  O. Sonnentag,et al.  Climate change, phenology, and phenological control of vegetation feedbacks to the climate system , 2013 .

[2]  Hulya Yalcin,et al.  Phenology monitoring of agricultural plants using texture analysis , 2015, 2016 24th Signal Processing and Communication Application Conference (SIU).

[3]  Ravi Kiran Sarvadevabhatla,et al.  A Taxonomy of Deep Convolutional Neural Nets for Computer Vision , 2016, Front. Robot. AI.

[4]  Alfredo R. Huete,et al.  A spatially explicit land surface phenology data product for science, monitoring and natural resources management applications , 2015, Environ. Model. Softw..

[5]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[6]  Iakovos S. Venieris,et al.  Changing the Game of Mobile Data Analysis with Deep Learning , 2017 .

[7]  Rahul Sukthankar,et al.  Classification of plant structures from uncalibrated image sequences , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[8]  Jianhui Li,et al.  Framework for phenology analyses from observation data of digital images and meteorological data , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE).

[9]  M. Srbinovska,et al.  Environmental parameters monitoring in precision agriculture using wireless sensor networks , 2015 .

[10]  Limin Luo,et al.  Moment-Based Approaches in Imaging. 1. Basic Features [A Look At ...] , 2007, IEEE Engineering in Medicine and Biology Magazine.

[11]  F. Fnaiech,et al.  Interest of the multi-resolution analysis based on the co-occurrence matrix for texture classification , 2008, MELECON 2008 - The 14th IEEE Mediterranean Electrotechnical Conference.

[12]  Tristan Perez,et al.  Fine-Grained Plant Classification Using Convolutional Neural Networks for Feature Extraction , 2014, CLEF.

[13]  Anup Vibhute,et al.  Applications of Image Processing in Agriculture: A Survey , 2012 .

[14]  Xiwen Luo,et al.  Advances in Non-Destructive Measurement and 3D Visualization Methods for Plant Root Based on Machine Vision , 2009, 2009 2nd International Conference on Biomedical Engineering and Informatics.

[15]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[16]  R. Javidan,et al.  A Comparative study between wavelet and Contourlet Transform Features for Textural Image Classification , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[17]  A. Coleman,et al.  An Adaptive Landscape Classification Procedure using Geoinformatics and Artificial Neural Networks , 2008 .

[18]  H. Mooney,et al.  Shifting plant phenology in response to global change. , 2007, Trends in ecology & evolution.

[19]  Salem Nasri,et al.  Texture classification of woven fabric based on a GLCM method and using multiclass support vector machine , 2009, 2009 6th International Multi-Conference on Systems, Signals and Devices.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.