Time series-based classifier fusion for fine-grained plant species recognition

k-NN decision-making study that best fits the plant identification problem.Analysis of the relationship between hours/day and the different plant species.Correlation analysis between 39 different time series-based classifiers.Use of a classifier fusion framework to improve the effectiveness results.Reduction of the number of used classifiers, while maintaining high effectiveness results. Global warming and its resulting environmental changes surely are ubiquitous subjects nowadays and undisputedly important research topics. One way of tracking such environmental changes is by means of phenology, which studies natural periodic events and their relationship to climate. Phenology is seen as the simplest and most reliable indicator of the effects of climate change on plants and animals. The search for phenological information and monitoring systems has stimulated many research centers worldwide to pursue the development of effective and innovative solutions in this direction. One fundamental requirement for phenological systems is concerned with achieving fine-grained recognition of plants. In this sense, the present work seeks to understand specific properties of each target plant species and to provide the solutions for gathering specific knowledge of such plants for further levels of recognition and exploration in related tasks. In this work, we address some important questions such as: (i) how species from the same leaf functional group differ from each other; (ii) how different pattern classifiers might be combined to improve the effectiveness results in target species identification; and (iii) whether it is possible to achieve good classification results with fewer classifiers for fine-grained plant species identification. In this sense, we perform different analysis considering RGB color information channels from a digital hemispherical lens camera in different hours of day and plant species. A study about the correlation of classifiers associated with time series extracted from digital images is also performed. We adopt a successful selection and fusion framework to combine the most suitable classifiers and features improving the plant identification decision-making task as it is nearly impossible to develop just a single "silver bullet" image descriptor that would capture all subtle discriminatory features of plants within the same functional group. This adopted framework turns out to be an effective solution in the target task, achieving better results than well-known approaches in the literature.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Anderson Rocha,et al.  A framework for selection and fusion of pattern classifiers in multimedia recognition , 2014, Pattern Recognit. Lett..

[3]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[4]  Res Altwegg,et al.  Phenological Changes in the Southern Hemisphere , 2013, PloS one.

[5]  Jurandy Almeida,et al.  Plant Species Identification with Phenological Visual Rhythms , 2013, 2013 IEEE 9th International Conference on e-Science.

[6]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[7]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[9]  W. Verhoef,et al.  PROSPECT+SAIL models: A review of use for vegetation characterization , 2009 .

[10]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[11]  Jurandy Almeida,et al.  Deriving vegetation indices for phenology analysis using genetic programming , 2015, Ecol. Informatics.

[12]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[13]  D. Hollinger,et al.  Use of digital webcam images to track spring green-up in a deciduous broadleaf forest , 2007, Oecologia.

[14]  Andrew D Richardson,et al.  Near-surface remote sensing of spatial and temporal variation in canopy phenology. , 2009, Ecological applications : a publication of the Ecological Society of America.

[15]  Jurandy Almeida,et al.  Shape-based time series analysis for remote phenology studies , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[16]  Michel M. Verstraete,et al.  Radiation transfer in plant canopies: Scattering of solar radiation and canopy reflectance , 1988 .

[17]  Jurandy Almeida,et al.  Applying machine learning based on multiscale classifiers to detect remote phenology patterns in Cerrado savanna trees , 2014, Ecol. Informatics.

[18]  H. Wanner,et al.  Tree phenology and carbon dioxide fluxes - use of digital photography for process-based interpretation at the ecosystem scale , 2009 .

[19]  Jurandy Almeida,et al.  Phenological Event Detection by Visual Rhythms Dissimilarity Analysis , 2014, 2014 IEEE 10th International Conference on e-Science.

[20]  A FoxEdward,et al.  A digital library framework for biodiversity information systems , 2006 .

[21]  Jurandy Almeida,et al.  Evaluation of Time Series Distance Functions in the Task of Detecting Remote Phenology Patterns , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  L. Eklundh,et al.  A physically based vegetation index for improved monitoring of plant phenology , 2014 .

[23]  H. Mooney,et al.  Shifting plant phenology in response to global change. , 2007, Trends in ecology & evolution.

[24]  T. Kataoka,et al.  Crop growth estimation system using machine vision , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[25]  Edward A. Fox,et al.  International Journal on Digital Libraries manuscript No. (will be inserted by the editor) A Digital Library Framework for Biodiversity Information Systems , 2022 .

[26]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[27]  Jurandy Almeida,et al.  Using phenological cameras to track the green up in a cerrado savanna and its on-the-ground validation , 2014, Ecol. Informatics.

[28]  F. Truchetet,et al.  Crop/weed discrimination in perspective agronomic images , 2008 .

[29]  Jurandy Almeida,et al.  Visual rhythm-based time series analysis for phenology studies , 2013, 2013 IEEE International Conference on Image Processing.