A proposed framework for the development and qualitative evaluation of West Nile virus models and their application to local public health decision-making

West Nile virus (WNV) is a globally distributed mosquito-borne virus of great public health concern. The number of WNV human cases and mosquito infection patterns vary in space and time. Many statistical models have been developed to understand and predict WNV geographic and temporal dynamics. However, these modeling efforts have been disjointed with little model comparison and inconsistent validation. In this paper, we describe a framework to unify and standardize WNV modeling efforts nationwide. WNV risk, detection, or warning models for this review were solicited from active research groups working in different regions of the United States. A total of 13 models were selected and described. The spatial and temporal scales of each model were compared to guide the timing and the locations for mosquito and virus surveillance, to support mosquito vector control decisions, and to assist in conducting public health outreach campaigns at multiple scales of decision-making. Our overarching goal is to bridge the existing gap between model development, which is usually conducted as an academic exercise, and practical model applications, which occur at state, tribal, local, or territorial public health and mosquito control agency levels. The proposed model assessment and comparison framework helps clarify the value of individual models for decision-making and identifies the appropriate temporal and spatial scope of each model. This qualitative evaluation clearly identifies gaps in linking models to applied decisions and sets the stage for a quantitative comparison of models. Specifically, whereas many coarse-grained models (county resolution or greater) have been developed, the greatest need is for fine-grained, short-term planning models (m–km, days–weeks) that remain scarce. We further recommend quantifying the value of information for each decision to identify decisions that would benefit most from model input.

[1]  A. C. Keyel,et al.  West Nile virus is predicted to be more geographically widespread in New York State and Connecticut under future climate change , 2021, Global change biology.

[2]  A. M. Kilpatrick,et al.  Probabilistic Evaluation of Null Models for West Nile Virus in the United States , 2021 .

[3]  M. Ruiz,et al.  Dynamics of data availability in disease modeling: An example evaluating the trade-offs of ultra-fine-scale factors applied to human West Nile virus disease models in the Chicago area, USA , 2021, bioRxiv.

[4]  R. Smith,et al.  Effects of Scale on Modeling West Nile Virus Disease Risk. , 2020, The American journal of tropical medicine and hygiene.

[5]  Jeremy M. Cohen,et al.  Transmission of West Nile and five other temperate mosquito-borne viruses peaks at temperatures between 23°C and 26°C , 2020, eLife.

[6]  M. Hayes,et al.  Using Climate to Explain and Predict West Nile Virus Risk in Nebraska , 2020, GeoHealth.

[7]  R. Smith,et al.  The drivers of West Nile virus human illness in the Chicago, Illinois, USA area: Fine scale dynamic effects of weather, mosquito infection, social, and biological conditions , 2020, PloS one.

[8]  A. Hess,et al.  Management. , 2020, Anesthesiology.

[9]  Osonde Osoba,et al.  An open challenge to advance probabilistic forecasting for dengue epidemics , 2019, Proceedings of the National Academy of Sciences.

[10]  A. C. Keyel,et al.  The Role of Temperature in Transmission of Zoonotic Arboviruses , 2019, Viruses.

[11]  A. M. Kilpatrick,et al.  Impact of West Nile Virus on Bird Populations: Limited Lasting Effects, Evidence for Recovery, and Gaps in Our Understanding of Impacts on Ecosystems , 2019, Journal of Medical Entomology.

[12]  C. Barker Models and Surveillance Systems to Detect and Predict West Nile Virus Outbreaks , 2019, Journal of Medical Entomology.

[13]  K. Knowlton,et al.  Estimating the Health‐Related Costs of 10 Climate‐Sensitive U.S. Events During 2012 , 2019, GeoHealth.

[14]  L. F. Chaves,et al.  The influence of weather and weather variability on mosquito abundance and infection with West Nile virus in Harris County, Texas, USA. , 2019, The Science of the total environment.

[15]  L. Kramer,et al.  Seasonal temperatures and hydrological conditions improve the prediction of West Nile virus infection rates in Culex mosquitoes and human case counts in New York and Connecticut , 2019, PloS one.

[16]  J. Shaman,et al.  Modeling and Surveillance of Reporting Delays of Mosquitoes and Humans Infected With West Nile Virus and Associations With Accuracy of West Nile Virus Forecasts , 2019, JAMA network open.

[17]  Samuel S. C. Rund,et al.  Rescuing Troves of Hidden Ecological Data to Tackle Emerging Mosquito-Borne Diseases. , 2019, Journal of the American Mosquito Control Association.

[18]  M. Wimberly,et al.  Identifying Environmental Risk Factors and Mapping the Distribution of West Nile Virus in an Endemic Region of North America , 2018, GeoHealth.

[19]  D. Fuller,et al.  Persistent Barriers to Implementing Efficacious Mosquito Control Activities in the Continental United States: Insights from Vector Control Experts , 2018, Current Topics in Neglected Tropical Diseases.

[20]  Justin K Davis,et al.  Improving the prediction of arbovirus outbreaks: A comparison of climate-driven models for West Nile virus in an endemic region of the United States. , 2018, Acta tropica.

[21]  R. Nasci,et al.  Standardized Operational Evaluations of Catch Basin Larvicides from Seven Mosquito Control Programs in the Midwestern United States During 2017. , 2018, Journal of the American Mosquito Control Association.

[22]  E. Muturi,et al.  Environmental and social-demographic predictors of the southern house mosquito Culex quinquefasciatus in New Orleans, Louisiana , 2018, Parasites & Vectors.

[23]  Jeffrey Shaman,et al.  Use of temperature to improve West Nile virus forecasts , 2017, PLoS Comput. Biol..

[24]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[25]  Scott C Brown,et al.  Host outdoor exposure variability affects the transmission and spread of Zika virus: Insights for epidemic control , 2017, PLoS neglected tropical diseases.

[26]  B. Biggerstaff,et al.  Bias Correction in Estimating Proportions by Pooled Testing , 2017, Journal of agricultural, biological, and environmental statistics.

[27]  Justin K Davis,et al.  Integrating Environmental Monitoring and Mosquito Surveillance to Predict Vector-borne Disease: Prospective Forecasts of a West Nile Virus Outbreak , 2017, PLoS currents.

[28]  Nicholas B. DeFelice,et al.  Ensemble forecast of human West Nile virus cases and mosquito infection rates , 2017, Nature Communications.

[29]  N. Diffenbaugh,et al.  Drought and immunity determine the intensity of West Nile virus epidemics and climate change impacts , 2017, Proceedings of the Royal Society B: Biological Sciences.

[30]  J. Shaman,et al.  Development and validation of a climate-based ensemble prediction model for West Nile Virus infection rates in Culex mosquitoes, Suffolk County, New York , 2016, Parasites & Vectors.

[31]  Andrew J Monaghan,et al.  Willingness to Pay for Mosquito Control in Key West, Florida and Tucson, Arizona. , 2016, The American journal of tropical medicine and hygiene.

[32]  M. Clark,et al.  Gridded Ensemble Precipitation and Temperature Estimates for the Contiguous United States , 2015 .

[33]  R. Harrigan,et al.  Persistent impacts of West Nile virus on North American bird populations , 2015, Proceedings of the National Academy of Sciences.

[34]  Laura D. Kramer,et al.  The Effect of Temperature on Life History Traits of Culex Mosquitoes , 2014, Journal of medical entomology.

[35]  David M. Hartley,et al.  A systematic review of mathematical models of mosquito-borne pathogen transmission: 1970–2010 , 2013, Journal of The Royal Society Interface.

[36]  Dawn Biehler,et al.  Higher Mosquito Production in Low-Income Neighborhoods of Baltimore and Washington, DC: Understanding Ecological Drivers and Mosquito-Borne Disease Risk in Temperate Cities , 2013, International journal of environmental research and public health.

[37]  John T. Abatzoglou,et al.  The West Wide Drought Tracker: Drought Monitoring at Fine Spatial Scales , 2013 .

[38]  J. Abatzoglou Development of gridded surface meteorological data for ecological applications and modelling , 2013 .

[39]  Katherine L. Dickinson,et al.  Willingness to pay for mosquito control: how important is West Nile virus risk compared to the nuisance of mosquitoes? , 2012, Vector borne and zoonotic diseases.

[40]  Nawi Ng,et al.  Optimal Lead Time for Dengue Forecast , 2012, PLoS neglected tropical diseases.

[41]  T. Carpenter,et al.  Comparison of Enzootic Risk Measures for Predicting West Nile Disease, Los Angeles, California, USA, 2004–2010 , 2012, Emerging infectious diseases.

[42]  Dina M Fonseca,et al.  "Bird biting" mosquitoes and human disease: a review of the role of Culex pipiens complex mosquitoes in epidemiology. , 2011, Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases.

[43]  S. Campbell,et al.  Predictive Mapping of Human Risk for West Nile Virus (WNV) Based on Environmental and Socioeconomic Factors , 2011, PloS one.

[44]  John F Anderson,et al.  Control of Mosquitoes in Catch Basins in Connecticut With Bacillus thuringiensis israelensis, Bacillus sphaericus, and Spinosad , 2011 .

[45]  S. Wood Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models , 2011 .

[46]  S. McLafferty,et al.  Mosquito politics: local vector control policies and the spread of West Nile Virus in the Chicago region. , 2010, Health & place.

[47]  L. F. Chaves,et al.  Local impact of temperature and precipitation on West Nile virus infection in Culex species mosquitoes in northeast Illinois, USA , 2010, Parasites & Vectors.

[48]  C. Daly,et al.  Physiographically sensitive mapping of climatological temperature and precipitation across the conterminous United States , 2008 .

[49]  J Elith,et al.  A working guide to boosted regression trees. , 2008, The Journal of animal ecology.

[50]  William K. Reisen,et al.  Early Impact of West Nile Virus on the Yellow-Billed Magpie (Pica Nuttalli) , 2008 .

[51]  W. Reisen,et al.  EVALUATION OF PYRETHRIN AERIAL ULTRA-LOW VOLUME APPLICATIONS FOR ADULT CULEX TARSALIS CONTROL IN THE DESERT ENVIRONMENTS OF THE COACHELLA VALLEY, RIVERSIDE COUNTY, CALIFORNIA , 2007, Journal of the American Mosquito Control Association.

[52]  Mercedes Pascual,et al.  Comparing Models for Early Warning Systems of Neglected Tropical Diseases , 2007, PLoS neglected tropical diseases.

[53]  P. Marra,et al.  West Nile virus emergence and large-scale declines of North American bird populations , 2007, Nature.

[54]  L. Kramer,et al.  West Nile virus , 2007, The Lancet Neurology.

[55]  Nicolai Meinshausen,et al.  Quantile Regression Forests , 2006, J. Mach. Learn. Res..

[56]  A. Spielman,et al.  Efficacy of resmethrin aerosols applied from the road for suppressing Culex vectors of West Nile virus. , 2006, Vector borne and zoonotic diseases.

[57]  B. Custer,et al.  West Nile Virus Infections Projected from Blood Donor Screening Data, United States, 2003 , 2006, Emerging infectious diseases.

[58]  Christopher J. Williams,et al.  Estimation of Pathogen Prevalence in Pooled Samples Using Maximum Likelihood Methods and Open-Source Software , 2005 .

[59]  Uriel Kitron,et al.  Environmental and social determinants of human risk during a West Nile virus outbreak in the greater Chicago area, 2002 , 2004, International journal of health geographics.

[60]  J. D. Tarpley,et al.  The multi‐institution North American Land Data Assimilation System (NLDAS): Utilizing multiple GCIP products and partners in a continental distributed hydrological modeling system , 2004 .

[61]  C. Barker,et al.  California state Mosquito-Borne Virus Surveillance and Response Plan: a retrospective evaluation using conditional simulations. , 2003, The American journal of tropical medicine and hygiene.

[62]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[63]  Jeffrey L. Anderson An Ensemble Adjustment Kalman Filter for Data Assimilation , 2001 .

[64]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[65]  Farzad Mostashari,et al.  Epidemic West Nile encephalitis, New York, 1999: results of a household-based seroepidemiological survey , 2001, The Lancet.

[66]  S D Walter,et al.  Estimation of infection rates in population of organisms using pools of variable size. , 1980, American journal of epidemiology.

[67]  H. Akaike A new look at the statistical model identification , 1974 .

[68]  W. Reeves,et al.  Epidemiology of the arthropod-borne viral encephalitides in Kern County, California, 1943-1952. , 1962, Publications in public health.

[69]  W. Reeves,et al.  Statistical estimation of virus infection rates in mosquito vector populations. , 1962, American journal of hygiene.

[70]  Jim Crawley,et al.  University of Oklahoma , 2019, The Grants Register 2022.

[71]  David A. W. Miller,et al.  Ruffed grouse population declines after introduction of West Nile virus , 2018 .

[72]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[73]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[74]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[75]  竹安 数博,et al.  Time series analysis and its applications , 2007 .

[76]  M. Khaitsa,et al.  The economic impact of West Nile virus infection in horses in the North Dakota equine industry in 2002 , 2007, Tropical Animal Health and Production.

[77]  David S. Stoffer,et al.  Time series analysis and its applications , 2000 .

[78]  C. Farrington Estimating prevalence by group testing using generalized linear models. , 1992, Statistics in medicine.