Fusion of time series representations for plant recognition in phenology studies

Abstract Nowadays, global warming and its resulting environmental changes is a hot topic in different biology research area. Phenology is one effective way of tracking such environmental changes through the study of plant’s periodic events and their relationship to climate. One promising research direction in this area relies on the use of vegetation images to track phenology changes over time. In this scenario, the creation of effective image-based plant identification systems is of paramount importance. In this paper, we propose the use of a new representation of time series to improve plants recognition rates. This representation, called recurrence plot (RP), is a technique for nonlinear data analysis, which represents repeated events on time series into a two-dimensional representation (an image). Therefore, image descriptors can be used to characterize visual properties from this RP images so that these features can be used as input of a classifier. To the best of our knowledge, this is the first work that uses recurrence plot for plant recognition task. Performed experiments show that RP can be a good solution to describe time series. In addition, in a comparison with visual rhythms (VR), another technique used for time series representation, RP shows a better performance to describe texture properties than VR. On the other hand, a correlation analysis and the adoption of a well successful classifier fusion framework show that both representations provide complementary information that is useful for improving classification accuracies.

[1]  Pavan K. Turaga,et al.  Recurrence textures for human activity recognition from compressive cameras , 2012, 2012 19th IEEE International Conference on Image Processing.

[2]  Renée J. Miller,et al.  Similarity search over time-series data using wavelets , 2002, Proceedings 18th International Conference on Data Engineering.

[3]  Vinícius M. A. de Souza,et al.  Time Series Classification Using Compression Distance of Recurrence Plots , 2013, 2013 IEEE 13th International Conference on Data Mining.

[4]  Anderson Rocha,et al.  A framework for selection and fusion of pattern classifiers in multimedia recognition , 2014, Pattern Recognit. Lett..

[5]  Jurandy Almeida,et al.  Time series-based classifier fusion for fine-grained plant species recognition , 2016, Pattern Recognit. Lett..

[6]  Andrew D Richardson,et al.  Near-surface remote sensing of spatial and temporal variation in canopy phenology. , 2009, Ecological applications : a publication of the Ecological Society of America.

[7]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[8]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[9]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[10]  Jurandy Almeida,et al.  Shape-based time series analysis for remote phenology studies , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[11]  Arnaldo de Albuquerque Araújo,et al.  Video segmentation based on 2D image analysis , 2003, Pattern Recognit. Lett..

[12]  M. D. Schwartz Phenology: An Integrative Environmental Science , 2003, Tasks for Vegetation Science.

[13]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Jurandy Almeida,et al.  Using phenological cameras to track the green up in a cerrado savanna and its on-the-ground validation , 2014, Ecol. Informatics.

[15]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[16]  Jurandy Almeida,et al.  Plant Species Identification with Phenological Visual Rhythms , 2013, 2013 IEEE 9th International Conference on e-Science.

[17]  Jurandy Almeida,et al.  Deriving vegetation indices for phenology analysis using genetic programming , 2015, Ecol. Informatics.

[18]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[19]  H. Wanner,et al.  Tree phenology and carbon dioxide fluxes - use of digital photography for process-based interpretation at the ecosystem scale , 2009 .

[20]  U. Rajendra Acharya,et al.  Automated EEG analysis of epilepsy: A review , 2013, Knowl. Based Syst..

[21]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[22]  Jurandy Almeida,et al.  Phenological visual rhythms: Compact representations for fine-grained plant species identification , 2016, Pattern Recognit. Lett..

[23]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[24]  D. Hollinger,et al.  Use of digital webcam images to track spring green-up in a deciduous broadleaf forest , 2007, Oecologia.

[25]  Jurandy Almeida,et al.  Evaluation of Time Series Distance Functions in the Task of Detecting Remote Phenology Patterns , 2014, 2014 22nd International Conference on Pattern Recognition.

[26]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Jurandy Almeida,et al.  Visual rhythm-based time series analysis for phenology studies , 2013, 2013 IEEE International Conference on Image Processing.

[28]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[29]  Eamonn J. Keogh,et al.  Locally adaptive dimensionality reduction for indexing large time series databases , 2001, SIGMOD '01.

[30]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[31]  Jurandy Almeida,et al.  Applying machine learning based on multiscale classifiers to detect remote phenology patterns in Cerrado savanna trees , 2014, Ecol. Informatics.

[32]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[33]  Vinícius M. A. de Souza,et al.  Extracting Texture Features for Time Series Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[34]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[35]  Mario A. Nascimento,et al.  A compact and efficient image retrieval approach based on border/interior pixel classification , 2002, CIKM '02.

[36]  Eamonn J. Keogh,et al.  Experimental comparison of representation methods and distance measures for time series data , 2010, Data Mining and Knowledge Discovery.

[37]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.