Detecting diversity: emerging methods to estimate species diversity.

Estimates of species richness and diversity are central to community and macroecology and are frequently used in conservation planning. Commonly used diversity metrics account for undetected species primarily by controlling for sampling effort. Yet the probability of detecting an individual can vary among species, observers, survey methods, and sites. We review emerging methods to estimate alpha, beta, gamma, and metacommunity diversity through hierarchical multispecies occupancy models (MSOMs) and multispecies abundance models (MSAMs) that explicitly incorporate observation error in the detection process for species or individuals. We examine advantages, limitations, and assumptions of these detection-based hierarchical models for estimating species diversity. Accounting for imperfect detection using these approaches has influenced conclusions of comparative community studies and creates new opportunities for testing theory.

[1]  J. Andrew Royle,et al.  Estimating species richness and accumulation by modeling species occurrence and detectability. , 2006, Ecology.

[2]  E. H. Simpson.  Measurement of Diversity , 1949, Nature.

[3]  J. Andrew Royle,et al.  Multi-species occurrence models to evaluate the effects of conservation and management actions , 2010 .

[4]  Aaron M Ellison,et al.  Observer bias and the detection of low-density populations. , 2009, Ecological applications : a publication of the Ecological Society of America.

[5]  H. Possingham,et al.  Spatial conservation prioritization: Quantitative methods and computational tools , 2009, Environmental Conservation.

[6]  Kiva L. Oken,et al.  A Bayesian hierarchical occupancy model for track surveys conducted in a series of linear, spatially correlated, sites , 2011 .

[7]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[8]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[9]  James S. Clark,et al.  HIERARCHICAL BAYES FOR STRUCTURED, VARIABLE POPULATIONS: FROM RECAPTURE DATA TO LIFE‐HISTORY PREDICTION , 2005 .

[10]  J. Ahumada,et al.  Community structure and diversity of tropical forest mammals: data from a global camera trap network , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Jason T. Bried,et al.  Bias of reduced‐effort community surveys for adult Odonata of lentic waters , 2012 .

[12]  Aaron M. Ellison,et al.  Modern Methods of Estimating Biodiversity from Presence-Absence Surveys , 2011 .

[13]  K. Pollock,et al.  Factors affecting aural detections of songbirds. , 2007, Ecological applications : a publication of the Ecological Society of America.

[14]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[15]  Péter Sólymos,et al.  Conditional likelihood approach for analyzing single visit abundance survey data in the presence of zero inflation and detection error , 2012 .

[16]  J. Andrew Royle,et al.  Estimating Size and Composition of Biological Communities by Modeling the Occurrence of Species , 2005 .

[17]  A. Chao.  Estimating the population size for capture-recapture data with unequal catchability. , 1987, Biometrics.

[18]  Robert K. Colwell,et al.  ESTIMATION OF SPECIES RICHNESS: MIXTURE MODELS, THE ROLE OF RARE SPECIES, AND INFERENTIAL CHALLENGES , 2005 .

[19]  J. Andrew Royle,et al.  ESTIMATING SITE OCCUPANCY RATES WHEN DETECTION PROBABILITIES ARE LESS THAN ONE , 2002, Ecology.

[20]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[21]  Antoine Guisan,et al.  Spatial modelling of biodiversity at the community level , 2006 .

[22]  Michael Schaub,et al.  Bayesian Population Analysis using WinBUGS: A Hierarchical Perspective , 2011 .

[23]  Kenneth H. Pollock,et al.  Experimental Investigation of Observation Error in Anuran Call Surveys , 2010 .

[24]  J. Brashares,et al.  Hierarchical Multi-Species Modeling of Carnivore Responses to Hunting, Habitat and Prey in a West African Protected Area , 2012, PloS one.

[25]  Robert K. Colwell,et al.  Abundance‐Based Similarity Indices and Their Estimation When There Are Unseen Species in Samples , 2006, Biometrics.

[26]  Hugh Sweatman,et al.  Spatial variation in the functional characteristics of herbivorous fish communities and the resilience of coral reefs. , 2013, Ecological applications : a publication of the Ecological Society of America.

[27]  A. Gelfand,et al.  Modelling species diversity through species level hierarchical modelling , 2005 .

[28]  R. H. Whittaker,et al.  Dominance and Diversity in Land Plant Communities , 1965, Science.

[29]  R. O’Hara,et al.  A review of Bayesian variable selection methods: what, how and which , 2009 .

[30]  Kevin J Gaston,et al.  Occupancy, Spatial Variance, and the Abundance of Species , 2003, The American Naturalist.

[31]  C. R. Dolan,et al.  Estimating Sampling Effort Required for Characterizing Species Richness and Site-to-Site Similarity in Fish Assemblage Surveys of Wadeable Illinois Streams , 2010 .

[32]  M. Williams.  Butterflies and day-flying moths in a fragmented urban landscape, south-west Western Australia: patterns of species richness , 2009 .

[33]  Elizabeth L. Sander,et al.  Rarefaction and extrapolation with Hill numbers: a framework for sampling and estimation in species diversity studies , 2014 .

[34]  Ché Elkin,et al.  Modeling abundance using N-mixture models: the importance of considering ecological mechanisms. , 2009, Ecological applications : a publication of the Ecological Society of America.

[35]  J. Andrew Royle,et al.  Hierarchical Bayes estimation of species richness and occupancy in spatially replicated surveys , 2008 .

[36]  R. Dorazio.  On the choice of statistical models for estimating occurrence and extinction from animal surveys. , 2007, Ecology.

[37]  A. Chao.  Nonparametric estimation of the number of classes in a population , 1984 .

[38]  J. Andrew Royle,et al.  Parameter-expanded data augmentation for Bayesian analysis of capture–recapture models , 2010, Journal of Ornithology.

[39]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[40]  Mathew A. Leibold,et al.  Metacommunities: Spatial Dynamics and Ecological Communities , 2005 .

[41]  James Rosindell,et al.  Unified neutral theory of biodiversity and biogeography , 2010, Scholarpedia.

[42]  M. Kéry,et al.  Imperfect detection is the rule rather than the exception in plant distribution studies , 2013 .

[43]  Jonathan M. Chase,et al.  The metacommunity concept: a framework for multi-scale community ecology , 2004 .

[44]  J Andrew Royle,et al.  Models for inference in dynamic metacommunity systems. , 2010, Ecology.

[45]  R. Dorazio,et al.  Estimating abundance while accounting for rarity, correlated behavior, and other sources of variation in counts. , 2013, Ecology.

[46]  D. MacKenzie.  Occupancy Estimation and Modeling: Inferring Patterns and Dynamics of Species Occurrence , 2005 .

[47]  J Andrew Royle,et al.  Generalized site occupancy models allowing for false positive and false negative errors. , 2006, Ecology.

[48]  J. Andrew Royle,et al.  Biodiversity of man-made open habitats in an underused country: a class of multispecies abundance models for count data , 2012, Biodiversity and Conservation.

[49]  K. Burnham,et al.  Robust Estimation of Population Size When Capture Probabilities Vary Among Animals , 1979 .

[50]  Robert M. Dorazio,et al.  Estimating Occupancy Dynamics in an Anuran Assemblage from Louisiana, USA , 2011 .

[51]  J. Hines,et al.  Two-species occupancy models: a new parameterization applied to co-occurrence of secretive rails. , 2010, Ecological applications : a publication of the Ecological Society of America.

[52]  M. Freeman,et al.  Estimating species occurrence, abundance, and detection probability using zero-inflated distributions. , 2008, Ecology.

[53]  J. Andrew Royle,et al.  ESTIMATING ABUNDANCE FROM REPEATED PRESENCE–ABSENCE DATA OR POINT COUNTS , 2003 .

[54]  William A. Link,et al.  Extremes in Ecology: Avoiding the Misleading Effects of Sampling Variation in Summary Analyses , 1996 .

[55]  F. W. Preston.  The Commonness, And Rarity, of Species , 1948 .

[56]  Elise F Zipkin,et al.  An Integrated Sampling and Analysis Approach for Improved Biodiversity Monitoring , 2010, Environmental management.

[57]  Marc Kéry,et al.  Estimating Abundance From Bird Counts: Binomial Mixture Models Uncover Complex Covariate Relationships , 2008 .

[58]  Viviana Ruiz-Gutierrez,et al.  Occupancy dynamics in a tropical bird community: unexpectedly high forest use by birds classified as non‐forest species , 2010 .

[59]  Wolfgang Schwanghart,et al.  Undersampling and the measurement of beta diversity , 2013 .

[60]  J. Andrew Royle,et al.  Impacts of forest fragmentation on species richness: a hierarchical approach to community modelling , 2009 .

[61]  Elise F Zipkin,et al.  Evaluating the predictive abilities of community occupancy models using AUC while accounting for imperfect detection. , 2012, Ecological applications : a publication of the Ecological Society of America.

[62]  David A. W. Miller,et al.  Improving occupancy estimation when two types of observational error occur: non-detection and species misidentification. , 2011, Ecology.

[63]  Larissa L. Bailey,et al.  Modeling co-occurrence of northern spotted and barred owls: Accounting for detection probability differences , 2009 .

[64]  D. King,et al.  A Small‐Scale Land‐Sparing Approach to Conserving Biological Diversity in Tropical Agricultural Landscapes , 2013, Conservation biology : the journal of the Society for Conservation Biology.

[65]  C. Robert,et al.  Deviance information criteria for missing data models , 2006 .

[66]  S. Buckland.  Introduction to distance sampling : estimating abundance of biological populations , 2001 .

[67]  K. Pollock,et al.  EXPERIMENTAL ANALYSIS OF THE AUDITORY DETECTION PROCESS ON AVIAN POINT COUNTS , 2007 .

[68]  J. Andrew Royle,et al.  Accounting for non‐independent detection when estimating abundance of organisms with a Bayesian approach , 2011 .

[69]  J. Andrew Royle,et al.  Inference About Species Richness and Community Structure Using Species-Specific Occupancy Models in the National Swiss Breeding Bird Survey MHB , 2009 .

[70]  A. Chao,et al.  Nonparametric estimation of Shannon’s index of diversity when there are unseen species in sample , 2004, Environmental and Ecological Statistics.

[71]  Robert M. Dorazio,et al.  Occupancy estimation and the closure assumption , 2009 .

[72]  E. Simms,et al.  LIFE HISTORY TRADE‐OFFS IN A RARE ORCHID: THE COSTS OF FLOWERING, DORMANCY, AND SPROUTING , 2003 .

[73]  Otso Ovaskainen,et al.  Making more out of sparse data: hierarchical modeling of species communities. , 2011, Ecology.

[74]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[75]  J. Wilson,et al.  Methods for fitting dominance/diversity curves , 1991 .

[76]  H. Meilby,et al.  Assessing the Population Status of a Tree Species Using Distance Sampling: Aquilaria crassna (Thymelaeaceae) in Northern Laos , 2012 .

[77]  J. Andrew Royle.  N‐Mixture Models for Estimating Population Size from Spatially Replicated Counts , 2004, Biometrics.

[78]  J. Andrew Royle,et al.  MODELING AVIAN ABUNDANCE FROM REPLICATED COUNTS USING BINOMIAL MIXTURE MODELS , 2005 .

[79]  J. Andrew Royle,et al.  Explaining Local-Scale Species Distributions: Relative Contributions of Spatial Autocorrelation and Landscape Heterogeneity for an Avian Assemblage , 2013, PloS one.

[80]  J. Harte.  Maximum Entropy and Ecology: A Theory of Abundance, Distribution, and Energetics , 2011 .

[81]  C. E. King.  RELATIVE ABUNDANCE OF SPECIES AND MACARTHUR'S MODEL , 1964 .

[82]  A. Magurran,et al.  Measuring Biological Diversity , 2004 .

[83]  S. Beissinger,et al.  Cryptic loss of montane avian richness and high community turnover over 100 years. , 2013, Ecology.

[84]  J. Andrew Royle,et al.  Hierarchical Modeling and Inference in Ecology: The Analysis of Data from Populations, Metapopulations and Communities , 2008 .

[85]  R. Millar,et al.  Comparison of Hierarchical Bayesian Models for Overdispersed Count Data using DIC and Bayes' Factors , 2009, Biometrics.

[86]  S. T. Buckland,et al.  Line Transect Methods for Plant Surveys , 2007, Biometrics.

[87]  Aaron M Ellison,et al.  Partitioning diversity. , 2010, Ecology.

[88]  J. Andrew Royle,et al.  Species richness and occupancy estimation in communities subject to temporary emigration. , 2009, Ecology.

[89]  S. Sarkar,et al.  Systematic conservation planning , 2000, Nature.

[90]  Robert M Dorazio,et al.  A new parameterization for estimating co-occurrence of interacting species. , 2010, Ecological applications : a publication of the Ecological Society of America.

[91]  Robert K. Colwell,et al.  A new statistical approach for assessing similarity of species composition with incidence and abundance data , 2004 .

[92]  M. Conroy,et al.  Accounting for detectability in reef-fish biodiversity estimates , 2008 .

[93]  J Andrew Royle,et al.  Modeling the effects of environmental disturbance on wildlife communities: avian responses to prescribed fire. , 2009, Ecological applications : a publication of the Ecological Society of America.