Sensitivity of species-distribution models to error, bias, and model design: An application to resource selection functions for woodland caribou

Models that predict distribution are now widely used to understand the patterns and processes of plant and animal occurrence as well as to guide conservation and management of rare or threatened species. Application of these methods has led to corresponding studies evaluating the sensitivity of model performance to requisite data and other factors that may lead to imprecise or false inferences. We expand upon these works by providing a relative measure of the sensitivity of model parameters and prediction to common sources of error, bias, and variability. We used a one-at-a-time sample design and GPS location data for woodland caribou (Rangifer tarandus caribou) to assess one common species-distribution model: a resource selection function. Our measures of sensitivity included change in coefficient values, prediction success, and the area of mapped habitats following the systematic introduction of geographic error and bias in occurrence data, thematic misclassification of resource maps, and variation in model design. Results suggested that error, bias and model variation have a large impact on the direct interpretation of coefficients. Prediction success and definition of important habitats were less responsive to the perturbations we introduced to the baseline model. Model coefficients, prediction success, and area of ranked habitats were most sensitive to positional error in species locations followed by sampling bias, misclassification of resources, and variation in model design. We recommend that researchers report, and practitioners consider, levels of error and bias introduced to predictive species-distribution models. Formal sensitivity and uncertainty analyses are the most effective means for evaluating and focusing improvements on input data and considering the range of values possible from imperfect models.

[1]  M. Boyce,et al.  WOLVES INFLUENCE ELK MOVEMENTS: BEHAVIOR SHAPES A TROPHIC CASCADE IN YELLOWSTONE NATIONAL PARK , 2005 .

[2]  David B. Marx,et al.  Mitigating spatial differences in observation rate of automated telemetry systems , 1998 .

[3]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[4]  Monica G. Turner,et al.  Scale and heterogeneity in habitat selection by elk in Yellowstone National Park , 2003 .

[5]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis: tools for GIS-based model implementation , 2001, Int. J. Geogr. Inf. Sci..

[6]  M. Aldenderfer,et al.  Cluster Analysis. Sage University Paper Series On Quantitative Applications in the Social Sciences 07-044 , 1984 .

[7]  R. Swihart,et al.  Absent or undetected? Effects of non-detection of species occurrence on wildlife-habitat models , 2004 .

[8]  David A. Elston,et al.  Empirical models for the spatial distribution of wildlife , 1993 .

[9]  Kevin P. Kenow,et al.  Evaluating habitat selection with radio-telemetry triangulation error , 1992 .

[10]  Tx Station Stata Statistical Software: Release 7. , 2001 .

[11]  Douglas H. Johnson THE COMPARISON OF USAGE AND AVAILABILITY MEASUREMENTS FOR EVALUATING RESOURCE PREFERENCE , 1980 .

[12]  E. Ziegel,et al.  Bootstrapping: A Nonparametric Approach to Statistical Inference , 1993 .

[13]  Bette A. Loiselle,et al.  Avoiding Pitfalls of Using Species Distribution Models in Conservation Planning , 2003 .

[14]  Antoine Guisan,et al.  Predictive habitat distribution models in ecology , 2000 .

[15]  Lars Edenius,et al.  Field test of a GPS location system for moose Alces alces under Scandinavian boreal conditions , 1997, Wildlife Biology.

[16]  Roger Wheate,et al.  Characterizing woodland caribou habitat in sub-boreal and boreal forests , 2003 .

[17]  D. Diefenbach,et al.  VARIABILITY IN GRASSLAND BIRD COUNTS RELATED TO OBSERVER DIFFERENCES AND SPECIES DETECTION RATES , 2003 .

[18]  J. Rhymer,et al.  HABITAT SELECTION BY WOOD TURTLES (CLEMMYS INSCULPTA): AN APPLICATION OF PAIRED LOGISTIC REGRESSION , 2002 .

[19]  H. Possingham,et al.  IMPROVING PRECISION AND REDUCING BIAS IN BIOLOGICAL SURVEYS: ESTIMATING FALSE‐NEGATIVE ERROR RATES , 2003 .

[20]  Yosef Cohen,et al.  Effects of moose movement and habitat use on GPS collar performance , 1996 .

[21]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[22]  M. Boyce,et al.  Evaluating resource selection functions , 2002 .

[23]  D. Peddle,et al.  An Integrated Decision Tree Approach (IDTA) to Mapping Landcover Using Satellite Remote Sensing in Support of Grizzly Bear Habitat Analysis in the Alberta Yellowhead Ecosystem , 2001 .

[24]  D. Seip,et al.  Grizzly Bear Behavior and Global Positioning System Collar Fix Rates , 2008 .

[25]  S. Cherry,et al.  USE AND INTERPRETATION OF LOGISTIC REGRESSION IN HABITAT-SELECTION STUDIES , 2004 .

[26]  Chris J. Johnson,et al.  Mapping uncertainty: sensitivity of wildlife habitat ratings to expert opinion , 2004 .

[27]  R. G. Wright,et al.  Integrating SAS and GIS software to improve habitat-use estimates from radiotelemetry data , 2001 .

[28]  A. Peterson,et al.  Predicting distributions of known and unknown reptile species in Madagascar , 2003, Nature.

[29]  Bryan F. J. Manly,et al.  Resource Selection by Animals , 1993, Springer Netherlands.

[30]  Chris J. Johnson,et al.  Resource Selection Functions Based on Use–Availability Data: Theoretical Motivation and Evaluation Methods , 2006 .

[31]  R. Löfstrand,et al.  Modeling Habitat Suitability for Moose in Coastal Northern Sweden: Empirical vs Process-oriented Approaches , 2003, Ambio.

[32]  M. Boyce,et al.  Relating populations to habitats using resource selection functions. , 1999, Trends in ecology & evolution.

[33]  M. Austin Species distribution models and ecological theory: A critical assessment and some possible new approaches , 2007 .

[34]  Helen M. Regan,et al.  Mapping epistemic uncertainties and vague concepts in predictions of species distribution , 2002 .

[35]  Bryan F. J. Manly,et al.  Assessing habitat selection when availability changes , 1996 .

[36]  Christopher O. Kochanny,et al.  GPS radiotelemetry error and bias in mountainous terrain , 2002 .

[37]  Philip D. McLoughlin,et al.  Overcoming radiotelemetry bias in habitat- selection studies , 1999 .

[38]  Chris J. Johnson,et al.  A MULTISCALE BEHAVIORAL APPROACH TO UNDERSTANDING THE MOVEMENTS OF WOODLAND CARIBOU , 2002 .

[39]  Mark S. Boyce,et al.  A quantitative approach to conservation planning: using resource selection functions to map the distribution of mountain caribou at multiple spatial scales , 2004 .

[40]  Helen M. Regan,et al.  A TAXONOMY AND TREATMENT OF UNCERTAINTY FOR ECOLOGY AND CONSERVATION BIOLOGY , 2002 .

[41]  Carl H. Key,et al.  Satellite telemetry: performance of animal-tracking systems , 1991 .

[42]  Simon Ferrier,et al.  Evaluating the predictive performance of habitat models developed using logistic regression , 2000 .

[43]  Brean W. Duncan,et al.  SETTING RELIABILITY BOUNDS ON HABITAT SUITABILITY INDICES , 2001 .

[44]  Chris J. Johnson,et al.  Expectations and realities of GPS animal location collars: results of three years in the field , 2002, Wildlife Biology.

[45]  Gordon B. Stenhouse,et al.  Removing GPS collar bias in habitat selection studies , 2004 .

[46]  R. Noss,et al.  CARNIVORES AS FOCAL SPECIES FOR CONSERVATION PLANNING IN THE ROCKY MOUNTAIN REGION , 2001 .

[47]  John W. Zimmerman,et al.  Radiotelemetry error : location error method compared with error polygons and confidence ellipses , 1995 .

[48]  D. Heard,et al.  Caribou in British Columbia: A 1996 status report , 1998 .

[49]  R. Morrison,et al.  The Use of Remote Sensing to Evaluate Shorebird Habitats and Populations on Prince Charles Island, Foxe Basin, Canada , 1997 .

[50]  R. Courtois,et al.  Effects of sampling effort based on GPS telemetry on home-range size estimations , 2002 .