A goodness‐of‐fit test for occupancy models with correlated within‐season revisits

Abstract Occupancy modeling is important for exploring species distribution patterns and for conservation monitoring. Within this framework, explicit attention is given to species detection probabilities estimated from replicate surveys to sample units. A central assumption is that replicate surveys are independent Bernoulli trials, but this assumption becomes untenable when ecologists serially deploy remote cameras and acoustic recording devices over days and weeks to survey rare and elusive animals. Proposed solutions involve modifying the detection‐level component of the model (e.g., first‐order Markov covariate). Evaluating whether a model sufficiently accounts for correlation is imperative, but clear guidance for practitioners is lacking. Currently, an omnibus goodness‐of‐fit test using a chi‐square discrepancy measure on unique detection histories is available for occupancy models (MacKenzie and Bailey, Journal of Agricultural, Biological, and Environmental Statistics, 9, 2004, 300; hereafter, MacKenzie–Bailey test). We propose a join count summary measure adapted from spatial statistics to directly assess correlation after fitting a model. We motivate our work with a dataset of multinight bat call recordings from a pilot study for the North American Bat Monitoring Program. We found in simulations that our join count test was more reliable than the MacKenzie–Bailey test for detecting inadequacy of a model that assumed independence, particularly when serial correlation was low to moderate. A model that included a Markov‐structured detection‐level covariate produced unbiased occupancy estimates except in the presence of strong serial correlation and a revisit design consisting only of temporal replicates. When applied to two common bat species, our approach illustrates that sophisticated models do not guarantee adequate fit to real data, underscoring the importance of model assessment. Our join count test provides a widely applicable goodness‐of‐fit test and specifically evaluates occupancy model lack of fit related to correlation among detections within a sample unit. Our diagnostic tool is available for practitioners that serially deploy survey equipment as a way to achieve cost savings.

[1]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[2]  J. Andrew Royle,et al.  Hierarchical Modeling and Inference in Ecology: The Analysis of Data from Populations, Metapopulations and Communities , 2008 .

[3]  A. F. O'connell,et al.  Multi-scale occupancy estimation and modelling using multiple detection methods , 2008 .

[4]  J. Nichols,et al.  Advances and applications of occupancy models , 2014 .

[5]  M. Lundy,et al.  The impact and implications of climate change for bats , 2013 .

[6]  P. Racey.  Ecological and Behavioral Methods for the Study of Bats , 2011 .

[7]  James A. Baldwin,et al.  Using echolocation monitoring to model bat occupancy and inform mitigations at wind energy facilities , 2012 .

[8]  J. Andrew Royle,et al.  Tigers on trails: occupancy modeling for cluster sampling. , 2009, Ecological applications : a publication of the Ecological Society of America.

[9]  J. M. Palmeirim,et al.  The Importance of Distance to Resources in the Spatial Modelling of Bat Foraging Habitat , 2011, PloS one.

[10]  Julia P. G. Jones.  Monitoring species abundance and distribution at the landscape scale , 2011 .

[11]  K. Vierling,et al.  A Practical Sampling Design for Acoustic Surveys of Bats , 2011 .

[12]  J. Hayes,et al.  Temporal Variation in Activity of Bats and the Design of Echolocation-Monitoring Studies , 1997 .

[13]  G. Guillera‐Arroita,et al.  Species Occupancy Modeling for Detection Data Collected Along a Transect , 2011 .

[14]  J. Andrew Royle,et al.  ESTIMATING SITE OCCUPANCY RATES WHEN DETECTION PROBABILITIES ARE LESS THAN ONE , 2002, Ecology.

[15]  P. Lukacs,et al.  Estimating occupancy using spatially and temporally replicated snow surveys , 2015 .

[16]  Thorsten M. Buzug,et al.  IR-04-067 Adaptive Speciation : Introduction , 2004 .

[17]  Chris Chatfield,et al.  Statistical Methods for Spatial Data Analysis , 2004 .

[18]  Luis J. Villanueva-Rivera,et al.  Using Automated Digital Recording Systems as Effective Tools for the Monitoring of Birds and Amphibians , 2006 .

[19]  Christopher M. Todd,et al.  Assessing Bat Detectability and Occupancy with Multiple Automated Echolocation Detectors , 2008 .

[20]  B. Furnas,et al.  Using automated recorders and occupancy models to monitor common forest birds across a large geographic region , 2015 .

[21]  Anaïs Charbonnel,et al.  Spatial replicates as an alternative to temporal replicates for occupancy modelling when surveys are based on linear features of the landscape , 2014 .

[22]  Elise F Zipkin,et al.  Evaluating the predictive abilities of community occupancy models using AUC while accounting for imperfect detection. , 2012, Ecological applications : a publication of the Ecological Society of America.

[23]  J. Andrew Royle,et al.  Applied Hierarchical Modeling in Ecology: Analysis of Distribution, Abundance and Species Richness in R and BUGS , 2015 .

[24]  D. MacKenzie.  Occupancy Estimation and Modeling: Inferring Patterns and Dynamics of Species Occurrence , 2005 .

[25]  T. Kunz,et al.  An Emerging Disease Causes Regional Population Collapse of a Common North American Bat Species , 2010, Science.

[26]  Darryl I. MacKenzie,et al.  Assessing the fit of site-occupancy models , 2004 .

[27]  B. Pinshow,et al.  Central-place foraging in nursing, arthropod-gleaning bats , 2008 .

[28]  Mark A. Hayes,et al.  Bats Killed in Large Numbers at United States Wind Energy Facilities , 2013 .

[29]  Roger Bivand,et al.  Comparing Implementations of Estimation Methods for Spatial Econometrics , 2015 .

[30]  A. Popa-Lisseanu,et al.  Giant noctule bats face conflicting constraints between roosting and foraging in a fragmented and heterogeneous landscape , 2009 .

[31]  Charles M. Francis,et al.  A plan for the North American Bat Monitoring Program (NABat) , 2015 .

[32]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[33]  Joern Fischer,et al.  Designing Effective Habitat Studies: Quantifying Multiple Sources of Variability in Bat Activity , 2009 .

[34]  L. Vierling,et al.  Establishing conservation baselines with dynamic distribution models for bat populations facing imminent decline , 2015 .