The virtual ecologist approach: simulating data and observers

Ecologists carry a well-stocked toolbox with a great variety of sampling methods, statistical analyses and modelling tools, and new methods are constantly appearing. Evaluation and optimisation of these methods is crucial to guide methodological choices. Simulating error-free data or taking high-quality data to qualify methods is common practice. Here, we emphasise the methodology of the ‘virtual ecologist’ (VE) approach where simulated data and observer models are used to mimic real species and how they are ‘virtually’ observed. This virtual data is then subjected to statistical analyses and modelling, and the results are evaluated against the ‘true’ simulated data. The VE approach is an intuitive and powerful evaluation framework that allows a quality assessment of sampling protocols, analyses and modelling tools. It works under controlled conditions as well as under consideration of confounding factors such as animal movement and biased observer behaviour. In this review, we promote the approach as a rigorous research tool, and demonstrate its capabilities and practical relevance. We explore past uses of VE in different ecological research fields, where it mainly has been used to test and improve sampling regimes as well as for testing and comparing models, for example species distribution models. We discuss its benefits as well as potential limitations, and provide some practical considerations for designing VE studies. Finally, research fields are identified for which the approach could be useful in the future. We conclude that VE could foster the integration of theoretical and empirical work and stimulate work that goes far beyond sampling methods, leading to new questions, theories, and better mechanistic understanding of ecological systems.

[1]  Atte Moilanen,et al.  The equilibrium assumption in estimating the parameters of metapopulation models. , 2000 .

[2]  N. Ratcliffe,et al.  Resolving the population status of Ascension Frigatebird Fregata aquila using a 'virtual ecologist' model , 2008 .

[3]  Volker Grimm,et al.  Individual-based modelling and ecological theory: synthesis of a workshop , 1999 .

[4]  L. Belbin,et al.  Evaluation of statistical models used for predicting plant species distributions: Role of artificial data and theory , 2006 .

[5]  Christian Wissel,et al.  Aims and limits of ecological modelling exemplified by island theory , 1992 .

[6]  R. Swihart,et al.  Absent or undetected? Effects of non-detection of species occurrence on wildlife-habitat models , 2004 .

[7]  I. Hanski.  Metapopulation dynamics , 1998, Nature.

[8]  Uta Berger,et al.  Virtual biologists observe virtual grasshoppers: an assessment of different mobility parameters for the analysis of movement patterns , 1999 .

[9]  Antoine Guisan,et al.  Predictive habitat distribution models in ecology , 2000 .

[10]  R. G. Davies,et al.  Methods to account for spatial autocorrelation in the analysis of species distributional data : a review , 2007 .

[11]  Atte Moilanen,et al.  ESTIMATING THE PARAMETERS OF SURVIVAL AND MIGRATION OF INDIVIDUALS IN METAPOPULATIONS , 2000 .

[12]  Olivier J. Hardy,et al.  Testing the spatial phylogenetic structure of local communities: statistical performances of different null models and test statistics on a locally neutral community , 2008 .

[13]  Atte Moilanen,et al.  Implications of empirical data quality to metapopulation model parameter estimation and application , 2002 .

[14]  Walter Jetz,et al.  Patterns and causes of species richness: a general simulation model for macroecology. , 2009, Ecology letters.

[15]  A. Hirzel,et al.  Assessing habitat-suitability models with a virtual species , 2001 .

[16]  Jan Pergl,et al.  Empirical and virtual investigation of the population dynamics of an alien plant under the constraints of local carrying capacity: Heracleum mantegazzianum in the Czech Republic , 2006 .

[17]  Lucille F. Stickel,et al.  A Comparison of Certain Methods of Measuring Ranges of Small Mammals , 1954 .

[18]  Bernd Gruber,et al.  A new method for estimating visitation rates of cryptic animals via repeated surveys of indirect signs , 2008 .

[19]  Katriona Shea,et al.  Optimizing dispersal study design by Monte Carlo simulation , 2005 .

[20]  Boris Schr,et al.  Constrain to perform: Regularization of habitat models , 2006 .

[21]  Benjamin M. Bolker,et al.  Ecological Models and Data in R , 2008 .

[22]  C. Dormann.  Promising the future? Global change projections of species distributions , 2007 .

[23]  Steven R. Beissinger,et al.  Evaluating at-sea sampling designs for Marbled Murrelets using a spatially explicit model , 2006 .

[24]  M. Sykes,et al.  Predicting global change impacts on plant species' distributions: Future challenges , 2008 .

[25]  Christof Bigler,et al.  Predicting tree mortality from growth data: how virtual ecologists can help real ecologists , 2007 .

[26]  Jessica Gurevitch,et al.  Ecography 25: 601 -- 615, 2002 , 2022 .

[27]  George Z. Gertner,et al.  Virtual experimentation: conceptual models and hypothesis testing of ecological scenarios , 1997 .

[28]  Werner Ulrich,et al.  Disentangling community patterns of nestedness and species co‐occurrence , 2007 .

[29]  Hugh P. Possingham,et al.  Reliability of Relative Predictions in Population Viability Analysis , 2003 .

[30]  D. Lindenmayer,et al.  INFERRING PROCESS FROM PATTERN: CAN TERRITORY OCCUPANCY PROVIDE INFORMATION ABOUT LIFE HISTORY PARAMETERS? , 2001 .

[31]  H. Possingham,et al.  IMPROVING PRECISION AND REDUCING BIAS IN BIOLOGICAL SURVEYS: ESTIMATING FALSE‐NEGATIVE ERROR RATES , 2003 .

[32]  S. Schueler,et al.  Estimating the density of ground-dwelling arthropods with pitfall traps using a nested-cross array , 2004 .

[33]  C. Meynard,et al.  Predicting species distributions: a critical comparison of the most common statistical models using artificial species , 2007 .

[34]  R. M. Nally.  Interaction strengths and spatial scale in community ecology: Simulated quadrat-sampling and confinement experiments involving animals of different mobilities , 2001 .

[35]  Steven L. Chown,et al.  Endemicity biases nestedness metrics: a demonstration, explanation and solution , 2006 .

[36]  C. Dormann,et al.  Static species distribution models in dynamically changing systems: how good can predictions really be? , 2009 .

[37]  George Z. Gertner,et al.  The role of interactions in hypothesis testing of ecological scenarios with process models , 1999 .

[38]  O. Phillips,et al.  Extinction risk from climate change , 2004, Nature.

[39]  J. Lobo,et al.  Threshold criteria for conversion of probability of species presence to either–or presence–absence , 2007 .

[40]  W. Thuiller.  Patterns and uncertainties of species' range shifts under climate change , 2004 .

[41]  Atte Moilanen,et al.  PATCH OCCUPANCY MODELS OF METAPOPULATION DYNAMICS: EFFICIENT PARAMETER ESTIMATION USING IMPLICIT STATISTICAL INFERENCE , 1999 .

[42]  Werner Ulrich,et al.  Null model analysis of species nestedness patterns. , 2007, Ecology.

[43]  Marie-Josée Fortin,et al.  Spatial autocorrelation and sampling design in plant ecology , 1989, Vegetatio.

[44]  J. Diniz‐Filho,et al.  Spatial analysis improves species distribution modelling during range expansion , 2008, Biology Letters.

[45]  D. DeAngelis,et al.  Individual-based modeling of ecological and evolutionary processes , 2005 .

[46]  David B. Lindenmayer,et al.  Treating the nestedness temperature calculator as a “black box” can lead to false conclusions , 2002 .

[47]  J. Hanspach,et al.  Climate and land use change impacts on plant distributions in Germany , 2008, Biology Letters.

[48]  Hans Joachim Poethke,et al.  Parameterizing, evaluating and comparing metapopulation models with data from individual-based simulations , 2006 .

[49]  J. Gamarra,et al.  Metapopulation Ecology , 2007 .

[50]  Fernando Gustavo Tomasel,et al.  Prediction of functional characteristics of ecosystems: a comparison of artificial neural networks and regression models , 1997 .

[51]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[52]  V. Grimm.  Ten years of individual-based modelling in ecology: what have we learned and what could we learn in the future? , 1999 .

[53]  John A. Wiens,et al.  Individual movements and estimation of population size in darkling beetles (Coleoptera: Tenebrionidae) , 1995 .

[54]  Campbell O. Webb,et al.  Trait Evolution, Community Assembly, and the Phylogenetic Structure of Ecological Communities , 2007, The American Naturalist.

[55]  Leah Gerber,et al.  PREDICTING EXTINCTION RISK IN SPITE OF PREDATOR–PREY OSCILLATIONS , 2007 .

[56]  Gretchen G. Moisen,et al.  Comparing five modelling techniques for predicting forest characteristics , 2002 .

[57]  F. Schurr,et al.  Estimating demographic models for the range dynamics of plant species , 2010 .

[58]  J. Hoeting,et al.  FACTORS AFFECTING SPECIES DISTRIBUTION PREDICTIONS: A SIMULATION MODELING EXPERIMENT , 2005 .

[59]  J. Timothy Wootton,et al.  Effects of birds on sea urchins and algae: A lower-intertidal trophic cascade , 1995 .

[60]  M. Araújo,et al.  How Does Climate Change Affect Biodiversity? , 2006, Science.

[61]  C. Albert,et al.  Favourability functions versus probability of presence: advantages and misuses , 2008 .

[62]  G. Huse.  Individual‐based Modeling and Ecology , 2008 .

[63]  Uta Berger,et al.  Pattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from Ecology , 2005, Science.

[64]  Howard B. Stauffer,et al.  WHAT CAN HABITAT PREFERENCE MODELS TELL US? TESTS USING A VIRTUAL TROUT POPULATION , 2003 .

[65]  Michael R. Willig,et al.  The role of stochastic processes in producing nested patterns of species distributions , 2006 .

[66]  A. Márcia Barbosa,et al.  Obtaining Environmental Favourability Functions from Logistic Regression , 2006, Environmental and Ecological Statistics.

[67]  A. Hirzel,et al.  Which is the optimal sampling strategy for habitat suitability modelling , 2002 .

[68]  Stefan Halle,et al.  Modelling activity synchronisation in free-ranging microtine rodents , 1999 .

[69]  Volker Grimm,et al.  Using pattern-oriented modeling for revealing hidden information: a key for reconciling ecological theory and application , 2003 .