Phenological Event Detection by Visual Rhythms Dissimilarity Analysis

Plant phenology has been exploited as an important research venue for assessing the impact of climate changes. One common approach for monitoring vegetation relies on the use of digital cameras. The employment of imaging techniques for phenological observation allows the extraction and analysis of visual characteristics based on color and texture information with the objective of determining plant life cycle changes, such as the beginning of the leaf flushing or the senescence period. This paper presents a novel approach for detecting phenological changes by analyzing image temporal series. Our method is based on the use of visual rhythm analysis and the adoption of a dissimilarity measure to detect visual changes in the time line. Experiments were conducted on a three-year data set composed of 3,538 vegetation images and 21 samples of 6 different species of interest. Results demonstrate that the proposed change detection approach is able to effectively identify phenological events.

[1]  O. Hoegh‐Guldberg,et al.  Ecological responses to recent climate change , 2002, Nature.

[2]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[3]  André R. S. Marçal,et al.  Phenology parameter extraction from time-series of satellite vegetation index data using phenosat , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[4]  D. Hollinger,et al.  Use of digital webcam images to track spring green-up in a deciduous broadleaf forest , 2007, Oecologia.

[5]  C. Rosenzweig,et al.  Attributing physical and biological impacts to anthropogenic climate change , 2008, Nature.

[6]  Mark A. Friedl,et al.  Digital repeat photography for phenological research in forest ecosystems , 2012 .

[7]  Gian-Reto Walther,et al.  Plants in a warmer world , 2003 .

[8]  Neucimar Jerônimo Leite,et al.  Morphological Residues and a General Framework for Image Filtering and Segmentation , 2001, EURASIP J. Adv. Signal Process..

[9]  S. Kurc,et al.  Digital image-derived greenness links deep soil moisture to carbon uptake in a creosotebush-dominated shrubland , 2010 .

[10]  Silvio Jamil Ferzoli Guimarães,et al.  Gradual transition detection based on bipartite graph matching approach , 2009, 2009 IEEE International Workshop on Multimedia Signal Processing.

[11]  Kenlo Nishida Nasahara,et al.  Using digital camera images to detect canopy condition of deciduous broad-leaved trees , 2011 .

[12]  G. Yohe,et al.  A globally coherent fingerprint of climate change impacts across natural systems , 2003, Nature.

[13]  Jurandy Almeida,et al.  Remote phenology: Applying machine learning to detect phenological patterns in a cerrado savanna , 2012, 2012 IEEE 8th International Conference on E-Science.

[14]  H. Wanner,et al.  Tree phenology and carbon dioxide fluxes - use of digital photography for process-based interpretation at the ecosystem scale , 2009 .

[15]  Jurandy Almeida,et al.  Using phenological cameras to track the green up in a cerrado savanna and its on-the-ground validation , 2014, Ecol. Informatics.

[16]  S. Domnic,et al.  Shot based keyframe extraction for ecological video indexing and retrieval , 2014, Ecol. Informatics.

[17]  Jin Liu,et al.  An adaptive video shot segmentation scheme based on dual-detection model , 2013, Neurocomputing.

[18]  Valerie A. Thomas,et al.  Fitting the Multitemporal Curve: A Fourier Series Approach to the Missing Data Problem in Remote Sensing Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Jurandy Almeida,et al.  Plant Species Identification with Phenological Visual Rhythms , 2013, 2013 IEEE 9th International Conference on e-Science.

[20]  Jurandy Almeida,et al.  Applying machine learning based on multiscale classifiers to detect remote phenology patterns in Cerrado savanna trees , 2014, Ecol. Informatics.

[21]  Christian Schuster,et al.  Multi-temporal detection of grassland vegetation with RapidEye imagery and a spectral-temporal library , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[22]  Andrew D Richardson,et al.  Near-surface remote sensing of spatial and temporal variation in canopy phenology. , 2009, Ecological applications : a publication of the Ecological Society of America.

[23]  Jurandy Almeida,et al.  Visual rhythm-based time series analysis for phenology studies , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Arnaldo de Albuquerque Araújo,et al.  Video segmentation based on 2D image analysis , 2003, Pattern Recognit. Lett..

[25]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Reiko Ide,et al.  Use of digital cameras for phenological observations , 2010, Ecol. Informatics.