The evaluation strip: A new and robust method for plotting predicted responses from species distribution models

Abstract Increasing use is being made in conservation management of statistical models that couple extensive collections of species and environmental data to make predictions of the geographic distributions of species. While the relationships fitted between a species and its environment are relatively transparent for many of these modeling techniques, others are more ‘black box’ in character, only producing geographic predictions and providing minimal or untraditional summaries of the fitted relationships on which these predictions are based. This in turn prevents robust evaluation of the ecological sensibility of such models, a necessary process if model predictions are to be treated with confidence. Here we propose a new but simple method for visualizing modeled responses that can be implemented with any modeling method, and demonstrate its application using five common methods applied to the prediction of an Australian tree species. This is achieved by insetting an “evaluation strip” into the spatial data layers, which, after predictions have been made, can be clipped out and used for creating plots of the modelled responses. We present findings of the application strip for algorithms GLMs, GAMs, CLIM, DOMAIN and MARS. Evaluation strips can be constructed to investigate either uni-variate responses, or the simultaneous variation in predicted values in relation to two variables. The latter option is particularly useful for evaluating responses in models that allow the fitting of complex interaction terms.

[1]  Geoffrey E. Hinton,et al.  A comparison of statistical learning methods on the Gusto database. , 1998, Statistics in medicine.

[2]  D. McKenney,et al.  A spatial, climate-determined risk rating for Scleroderris disease of pines in Ontario , 1998 .

[3]  J. Friedman Multivariate adaptive regression splines , 1990 .

[4]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[5]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[6]  Stephen T. Buckland,et al.  Predicting distributional change, with application to bird distributions in northeast Scotland , 1996 .

[7]  Gretchen G. Moisen,et al.  Comparing five modelling techniques for predicting forest characteristics , 2002 .

[8]  C. Braak Canonical Correspondence Analysis: A New Eigenvector Technique for Multivariate Direct Gradient Analysis , 1986 .

[9]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[10]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[11]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[12]  Helen M. Regan,et al.  Mapping epistemic uncertainties and vague concepts in predictions of species distribution , 2002 .

[13]  G. Carpenter,et al.  DOMAIN: a flexible modelling procedure for mapping potential distributions of plants and animals , 1993, Biodiversity & Conservation.

[14]  David R. Anderson,et al.  Model Selection and Inference: A Practical Information-Theoretic Approach , 2001 .

[15]  W. Thuiller BIOMOD – optimizing predictions of species distributions and projecting potential future shifts under global change , 2003 .

[16]  Robert P. Anderson,et al.  Maximum entropy modeling of species geographic distributions , 2006 .

[17]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[18]  William N. Venables,et al.  Modern Applied Statistics with S-Plus. , 1996 .

[19]  M. Austin Spatial prediction of species distribution: an interface between ecological theory and statistical modelling , 2002 .

[20]  R. Kadmon,et al.  EFFECT OF ROADSIDE BIAS ON THE ACCURACY OF PREDICTIVE MAPS PRODUCED BY BIOCLIMATIC MODELS , 2004 .

[21]  Anthony Lehmann,et al.  GRASP: generalized regression analysis and spatial prediction , 2002 .

[22]  A. Hirzel Linking landscape- and population ecology for large population management modelling: the case of Ibex (capra ibex) in Switzerland , 2001 .

[23]  Antoine Guisan,et al.  Predictive habitat distribution models in ecology , 2000 .

[24]  Michael Drielsma,et al.  Extended statistical approaches to modelling spatial pattern in biodiversity in northeast New South Wales. II. Community-level modelling , 2002, Biodiversity & Conservation.

[25]  Simon Ferrier,et al.  Evaluating the predictive performance of habitat models developed using logistic regression , 2000 .

[26]  J. Elder The Generalization Paradox of Ensembles , 2003 .

[27]  J. Busby BIOCLIM - a bioclimate analysis and prediction system , 1991 .

[28]  A. Lehmann,et al.  Predicting species spatial distributions using presence-only data: a case study of native New Zealand ferns , 2002 .

[29]  Julian D. Olden,et al.  A comparison of statistical approaches for modelling fish species distributions , 2002 .

[30]  Jesús Muñoz,et al.  Comparison of statistical methods commonly used in predictive modelling , 2004 .

[31]  J. Michael Scott,et al.  Predicting Species Occurrences: Issues of Accuracy and Scale , 2002 .

[32]  M. Schwartz,et al.  Population Viability in Plants , 2003, Ecological Studies.

[33]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[34]  R. Kadmon,et al.  A SYSTEMATIC ANALYSIS OF FACTORS AFFECTING THE PERFORMANCE OF CLIMATIC ENVELOPE MODELS , 2003 .

[35]  John Bell,et al.  A review of methods for the assessment of prediction errors in conservation presence/absence models , 1997, Environmental Conservation.

[36]  S. Weiss,et al.  GLM versus CCA spatial modeling of plant species distribution , 1999, Plant Ecology.

[37]  Igor Aleksander,et al.  Introduction to Neural Computing , 1990 .

[38]  Falk Huettmann,et al.  A large-scale model for the at-sea distribution and abundance of Marbled Murrelets (Brachyramphus marmoratus) during the breeding season in coastal British Columbia, Canada , 2004 .

[39]  Miguel B. Araújo,et al.  Selecting areas for species persistence using occurrence data , 2000 .

[40]  David R. B. Stockwell,et al.  The GARP modelling system: problems and solutions to automated spatial prediction , 1999, Int. J. Geogr. Inf. Sci..

[41]  D. Lindenmayer,et al.  Towards a hierarchical framework for modelling the spatial distribution of animals , 2001 .

[42]  J. Elith,et al.  Predictions and their validation: Rare plants in the Central Highlands, Victoria, Australia , 2002 .

[43]  C. Margules,et al.  Nature Conservation: Cost Effective Biological Surveys and Data Analysis , 1990 .

[44]  S. Ormerod,et al.  New paradigms for modelling species distributions , 2004 .