Visual rhythm-based time series analysis for phenology studies

Plant phenology has gained importance in the context of global change research, stimulating the development of new technologies for phenological observation. In this context, digital cameras have been successfully used as multi-channel imaging sensors, providing measures to estimate changes on phenological events, such as leaf flushing and senescence. We monitored leaf-changing patterns of a cerrado-savanna vegetation by taken daily digital images. For that, we extract leaf color information and correlated with phenological changes. In this way, time series associated with plant species are obtained, raising the need of using appropriate tools for mining patterns of interest. In this paper, we present a novel approach for representing phenological patterns of plant species. The proposed method is based on encoding time series as a visual rhythm, which is characterized by color description algorithms. A comparative analysis of different descriptors is conducted and discussed. Experimental results show that our approach presents high accuracy on identifying plant species.

[1]  Jurandy Almeida,et al.  Remote phenology: Applying machine learning to detect phenological patterns in a cerrado savanna , 2012, 2012 IEEE 8th International Conference on E-Science.

[2]  Jurandy Almeida,et al.  VISON: VIdeo Summarization for ONline applications , 2012, Pattern Recognit. Lett..

[3]  André R. S. Marçal,et al.  Phenology parameter extraction from time-series of satellite vegetation index data using phenosat , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[4]  Valentyn Tolpekin,et al.  Multitemporal change detection of urban trees using localized region - based active contours in VHR images , 2012 .

[5]  Mario A. Nascimento,et al.  A compact and efficient image retrieval approach based on border/interior pixel classification , 2002, CIKM '02.

[6]  Gian-Reto Walther,et al.  Plants in a warmer world , 2003 .

[7]  Jurandy Almeida,et al.  Fusion of Local and Global Descriptors for Content-Based Image and Video Retrieval , 2012, CIARP.

[8]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[9]  Nicolas Passat,et al.  Spatio-temporal reasoning for the classification of satellite image time series , 2012, Pattern Recognit. Lett..

[10]  Touradj Ebrahimi,et al.  Perceptual Video Compression: A Survey , 2012, IEEE Journal of Selected Topics in Signal Processing.

[11]  H. Wanner,et al.  Tree phenology and carbon dioxide fluxes - use of digital photography for process-based interpretation at the ecosystem scale , 2009 .

[12]  G. Yohe,et al.  A globally coherent fingerprint of climate change impacts across natural systems , 2003, Nature.

[13]  S. Kurc,et al.  Digital image-derived greenness links deep soil moisture to carbon uptake in a creosotebush-dominated shrubland , 2010 .

[14]  Valerie A. Thomas,et al.  Fitting the Multitemporal Curve: A Fourier Series Approach to the Missing Data Problem in Remote Sensing Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[15]  C. Rosenzweig,et al.  Attributing physical and biological impacts to anthropogenic climate change , 2008, Nature.

[16]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[17]  Reiko Ide,et al.  Use of digital cameras for phenological observations , 2010, Ecol. Informatics.

[18]  Jurandy Almeida,et al.  Making colors worth more than a thousand words , 2008, SAC '08.

[19]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  O. Hoegh‐Guldberg,et al.  Ecological responses to recent climate change , 2002, Nature.

[21]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[22]  Jurandy Almeida,et al.  Rapid Video Summarization on Compressed Video , 2010, 2010 IEEE International Symposium on Multimedia.

[23]  Christian Schuster,et al.  Multi-temporal detection of grassland vegetation with RapidEye imagery and a spectral-temporal library , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Jurandy Almeida,et al.  Rapid Cut Detection on Compressed Video , 2011, CIARP.

[25]  D. Hollinger,et al.  Use of digital webcam images to track spring green-up in a deciduous broadleaf forest , 2007, Oecologia.

[26]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Kenlo Nishida Nasahara,et al.  Using digital camera images to detect canopy condition of deciduous broad-leaved trees , 2011 .

[28]  Andrew D Richardson,et al.  Near-surface remote sensing of spatial and temporal variation in canopy phenology. , 2009, Ecological applications : a publication of the Ecological Society of America.

[29]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.