A framework for evaluating forest landscape model predictions using empirical data and knowledge

Evaluation of forest landscape model (FLM) predictions is indispensable to establish the credibility of predictions. We present a framework that evaluates short- and long-term FLM predictions at site and landscape scales. Site-scale evaluation is conducted through comparing raster cell-level predictions with inventory plot data whereas landscape-scale evaluation is conducted through comparing predictions stratified by extraneous drivers with aggregated values in inventory plots. Long-term predictions are evaluated using empirical data and knowledge. We demonstrate the applicability of the framework using LANDIS PRO FLM. We showed how inventory data were used to initialize the landscape and calibrate model parameters. Evaluation of the short-term LANDIS PRO predictions based on multiple metrics showed good overall performance at site and landscape scales. The predicted long-term stand development patterns were consistent with the established theories of stand dynamics. The predicted long-term forest composition and successional trajectories conformed well to empirical old-growth studies in the region. We present a framework for evaluating the short- and long-term forest landscape model predictions at site and landscape scales.Site-scale evaluation is conducted through comparing cell-level predictions with inventory plot data.Landscape-scale evaluation is conducted through comparing predictions stratified by extraneous drivers with aggregated values in inventory plots.We successfully evaluated the LANDIS PRO forest landscape model predictions using empirical data and knowledge and showed reasonable performances at both scales.

[1]  David J. Mladenoff,et al.  Design, development, and application of LANDIS-II, a spatial landscape simulation model with flexible temporal and spatial resolution , 2007 .

[2]  Stephen R. Shifley,et al.  Structural and compositional differences between old-growth and mature second-growth forests in the Missouri Ozarks , 1995 .

[3]  Edward F. Loewenstein,et al.  Age and diameter structure of a managed uneven-aged oak forest , 2000 .

[4]  Eric Heitzman Effects of Oak Decline on Species Composition in a Northern Arkansas Forest , 2003 .

[5]  Hong S. He,et al.  Simulating forest ecosystem response to climate warming incorporating spatial effects in north‐eastern China , 2005 .

[6]  D. C. West,et al.  Simulated Patterns of Forest Succession and Productivity as a Consequence of Altered Precipitation , 2003 .

[7]  K. Yoda,et al.  Self-thinning in overcrowded pure stands under cultivated and natural conditions (Intraspecific competition among higher plants. XI) , 1963 .

[8]  Hong S. He,et al.  An innovative computer design for modeling forest landscape change in very large spatial extents with fine resolutions , 2011 .

[9]  Lisa M. Holsinger,et al.  Climate change effects on historical range and variability of two large landscapes in western Montana, USA , 2008 .

[10]  Timothy G. F. Kittel,et al.  Validation of Simulated Runoff From Six Terrestrial Ecosystem Models: Results From Vemap , 2004 .

[11]  Benjamin Smith,et al.  Representation of vegetation dynamics in the modelling of terrestrial ecosystems: comparing two contrasting approaches within European climate space , 2008 .

[12]  D. Foster,et al.  The influence of land use and climate change on forest biomass and composition in Massachusetts, USA. , 2011, Ecological applications : a publication of the Ecological Society of America.

[13]  N. Zimmermann,et al.  TreeMig: A forest-landscape model for simulating spatio-temporal patterns from stand to landscape scale , 2006 .

[14]  Stephen R. Shifley,et al.  Characteristics and dynamics of an upland Missouri old-growth forest , 1995 .

[15]  George L. W. Perry,et al.  Spatial modelling of vegetation change in dynamic landscapes: a review of methods and applications , 2006 .

[16]  Chonggang Xu,et al.  Uncertainties in the response of a forest landscape to global climatic change , 2009 .

[17]  T. Spies,et al.  An Individual-Based Process Model to Simulate Landscape-Scale Forest Ecosystem Dynamics , 2012 .

[18]  Miguel G. Cruz,et al.  Are the applications of wildland fire behaviour models getting ahead of their evaluation again? , 2013, Environ. Model. Softw..

[19]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[20]  R. Burns,et al.  Silvics of North America: 1. Conifers; 2. Hardwoods , 1990 .

[21]  Ben Bond-Lamberty,et al.  Reimplementation of the Biome-BGC model to simulate successional change. , 2005, Tree physiology.

[22]  Hong S. He,et al.  A large‐scale forest landscape model incorporating multi‐scale processes and utilizing forest inventory data , 2013 .

[23]  S. Ollinger,et al.  Modeling nitrogen saturation in forest ecosystems in response to land use and atmospheric deposition , 1997 .

[24]  Hong S. He,et al.  Exploring component-based approaches in forest landscape modeling , 2002, Environ. Model. Softw..

[25]  Joslin L. Moore,et al.  The concepts of bias, precision and accuracy, and their use in testing the performance of species richness estimators, with a literature review of estimator performance , 2005 .

[26]  Boris Kompare,et al.  Environmental Modelling & Software , 2014 .

[27]  Juan A. Blanco,et al.  Testing the performance of a forest ecosystem model (FORECAST) against 29 years of field data in a Pseudotsuga menziesii plantation , 2007 .

[28]  Hong S. He,et al.  LANDIS PRO: a landscape model that predicts forest composition and structure changes at regional scales , 2014 .

[29]  Joshua J. Millspaugh,et al.  Models for planning wildlife conservation in large landscapes , 2009 .

[30]  W. Thuiller Patterns and uncertainties of species' range shifts under climate change , 2004 .

[31]  John W. Coulston,et al.  The Forest Inventory and Analysis Database Version 4.0: Database Description and Users Manual for Phase 3 , 2010 .

[32]  Shenfeng Fei,et al.  Ecological forecasting and data assimilation in a data-rich era. , 2011, Ecological applications : a publication of the Ecological Society of America.

[33]  M. P.R.,et al.  A METHOD FOR SCALING VEGETATION DYNAMICS: THE ECOSYSTEM DEMOGRAPHY MODEL (ED) , 2022 .

[34]  C. Oliver,et al.  Forest stand dynamics: updated edition. , 1996 .

[35]  Jian Yang,et al.  Effects of environmental heterogeneity on predictions of tree species' abundance in response to climate warming , 2014, Environ. Model. Softw..

[36]  Drew W. Purves,et al.  How Stand Productivity Results from Size- and Competition-Dependent Growth and Mortality , 2011, PloS one.

[37]  D. Mladenoff LANDIS and forest landscape models , 2004 .

[38]  H. Bugmann,et al.  The relative importance of climatic effects, wildfires and management for future forest landscape dynamics in the Swiss Alps , 2006 .

[39]  Paul R Moorcroft,et al.  How close are we to a predictive science of the biosphere? , 2006, Trends in ecology & evolution.

[40]  Hong S. He,et al.  Studying Fire Mitigation Strategies in Multi-Ownership Landscapes: Balancing the Management of Fire-Dependent Ecosystems and Fire Risk , 2009, Ecosystems.

[41]  F. Chapin,et al.  Changes in fire regime break the legacy lock on successional trajectories in Alaskan boreal forest , 2010 .

[42]  Aged Forests PERFECTING A STAND-DENSITY INDEX FOR EVEN- , 2010 .

[43]  Bruce C. Larson,et al.  Forest Stand Dynamics , 1990 .

[44]  H. Bugmann,et al.  Improving the formulation of tree growth and succession in a spatially explicit landscape model , 2004 .

[45]  Hong S. He,et al.  Forest landscape models: Definitions, characterization, and classification , 2008 .

[46]  J. Kattge,et al.  Improving assessment and modelling of climate change impacts on global terrestrial biodiversity. , 2011, Trends in ecology & evolution.

[47]  Ajith H. Perera,et al.  A spatially explicit stochastic model to simulate boreal forest cover transitions: general structure and properties , 2002 .

[48]  Volker Grimm,et al.  Ecological models supporting environmental decision making: a strategy for the future. , 2010, Trends in ecology & evolution.

[49]  Paul M. Feikema,et al.  Quantifying uncertainty from large‐scale model predictions of forest carbon dynamics , 2006 .

[50]  Jian Yang,et al.  Calibrating a forest landscape model to simulate frequent fire in Mediterranean-type shrublands , 2007, Environ. Model. Softw..

[51]  D. Mladenoff,et al.  Spatial Modeling of Forest Landscape Change: Approaches and Applications , 1999 .

[52]  L. Mermet,et al.  The rise of research on futures in ecology: rebalancing scenarios and predictions. , 2009, Ecology letters.

[53]  Daniel C. Dey,et al.  A Stocking Diagram for Midwestern Eastern Cottonwood-Silver Maple-American Sycamore Bottomland Forests , 2010 .

[54]  M. Araújo,et al.  Validation of species–climate impact models under climate change , 2005 .

[55]  G. Mace,et al.  Beyond Predictions: Biodiversity Conservation in a Changing Climate , 2011, Science.

[56]  William D. Dijak Landscape Builder: Software for the creation of initial landscapes for LANDIS from FIA data , 2013 .

[57]  Stephen R. Shifley,et al.  The Ecology and Silviculture of Oaks, Second Edition: A new book , 2011 .

[58]  Edward J. Rykiel,et al.  Testing ecological models: the meaning of validation , 1996 .

[59]  Hong Jiang,et al.  Integrating models with data in ecology and palaeoecology: advances towards a model-data fusion approach. , 2011, Ecology letters.

[60]  Joshua J. Millspaugh,et al.  Validation of Landscape-Scale Decision Support Models That Predict Vegetation and Wildlife Dynamics , 2009 .

[61]  D. Mladenoff,et al.  Design, behavior and application of LANDIS, an object-oriented model of forest landscape disturbance and succession. , 1999 .

[62]  James S. Clark,et al.  A future for models and data in environmental science. , 2006, Trends in ecology & evolution.

[63]  Robert H. Gardner,et al.  Model Validation and Testing: , 2021 .

[64]  James N. Long,et al.  Linkages between silviculture and ecology: an analysis of density management diagrams , 1996 .

[65]  Hong S. He,et al.  Simulating stand-level harvest prescriptions across landscapes: LANDIS PRO harvest module design , 2013 .

[66]  Wilfried Thuiller,et al.  Climate change impacts on tree ranges: model intercomparison facilitates understanding and quantification of uncertainty. , 2012, Ecology letters.

[67]  Paul S. Johnson,et al.  The Ecology and Silviculture of Oaks , 2002 .

[68]  A. Solomon,et al.  Forest dynamics in Oregon landscapes: evaluation and application of an individual-based model. , 2007, Ecological applications : a publication of the Ecological Society of America.

[69]  S. Levin,et al.  Mathematical and Computational Challenges in Population Biology and Ecosystems Science , 1997, Science.

[70]  B. C. Ward,et al.  Simulating landscape-scale effects of fuels treatments in the Sierra Nevada, California, USA , 2011 .

[71]  Hong S. He,et al.  Spatial simulation of the effect of fire and harvest on aboveground tree biomass in boreal forests of Northeast China , 2014, Landscape Ecology.

[72]  Hong S. He,et al.  SPATIALLY EXPLICIT AND STOCHASTIC SIMULATION OF FOREST- LANDSCAPE FIRE DISTURBANCE AND SUCCESSION , 1999 .

[73]  Hong S. He,et al.  Modeling the Effects of Harvest Alternatives on Mitigating Oak Decline in a Central Hardwood Forest Landscape , 2013, PloS one.

[74]  Steven J. Phillips,et al.  WHAT MATTERS FOR PREDICTING THE OCCURRENCES OF TREES: TECHNIQUES, DATA, OR SPECIES' CHARACTERISTICS? , 2007 .

[75]  Samuel F. Ginrich Measuring and Evaluating Stocking and Stand Density in Upland Hardwood Forests in the Central States , 1967 .

[76]  Luis Samaniego,et al.  Technical assessment and evaluation of environmental models and software: Letter to the Editor , 2011, Environ. Model. Softw..