Comparing Models for Early Warning Systems of Neglected Tropical Diseases

Background Early warning systems (EWS) are management tools to predict the occurrence of epidemics of infectious diseases. While climate-based EWS have been developed for malaria, no standard protocol to evaluate and compare EWS has been proposed. Additionally, there are several neglected tropical diseases whose transmission is sensitive to environmental conditions, for which no EWS have been proposed, though they represent a large burden for the affected populations. Methodology/Principal Findings In the present paper, an overview of the available linear and non-linear tools to predict seasonal time series of diseases is presented. Also, a general methodology to compare and evaluate models for prediction is presented and illustrated using American cutaneous leishmaniasis, a neglected tropical disease, as an example. The comparison of the different models using the predictive R 2 for forecasts of “out-of-fit” data (data that has not been used to fit the models) shows that for the several linear and non-linear models tested, the best results were obtained for seasonal autoregressive (SAR) models that incorporate climatic covariates. An additional bootstrapping experiment shows that the relationship of the disease time series with the climatic covariates is strong and consistent for the SAR modeling approach. While the autoregressive part of the model is not significant, the exogenous forcing due to climate is always statistically significant. Prediction accuracy can vary from 50% to over 80% for disease burden at time scales of one year or shorter. Conclusions/Significance This study illustrates a protocol for the development of EWS that includes three main steps: (i) the fitting of different models using several methodologies, (ii) the comparison of models based on the predictability of “out-of-fit” data, and (iii) the assessment of the robustness of the relationship between the disease and the variables in the model selected as best with an objective criterion.

[1]  L. F. Chaves.  Casas Muertas and Oficina No. 1: internal migrations and malaria trends in Venezuela 1905–1945 , 2007, Parasitology Research.

[2]  S. C..  The Seasonal Periodicity of Malaria and the Mechanism of the Epidemic Wave , 1938, Nature.

[3]  Gerard Borsboom,et al.  Forecasting malaria incidence from historical morbidity patterns in epidemic‐prone areas of Ethiopia: a simple seasonal adjustment method performs best , 2002, Tropical medicine & international health : TM & IH.

[4]  S. Hales,et al.  Infectious Diseases, Climate Influences, and Nonstationarity , 2006, PLoS medicine.

[5]  M. Hulme,et al.  A high-resolution data set of surface climate over global land areas , 2002 .

[6]  M. B. Priestley,et al.  Non-linear and non-stationary time series analysis , 1990 .

[7]  L. F. Chaves,et al.  Sources and sinks: revisiting the criteria for identifying reservoirs for American cutaneous leishmaniasis. , 2007, Trends in parasitology.

[8]  K. Wolter,et al.  Measuring the strength of ENSO events: How does 1997/98 rank? , 1998 .

[9]  R. Levins.  The strategy of model building in population biology , 1966 .

[10]  Stephen P. Ellner,et al.  Chaos in a Noisy World: New Methods and Evidence from Time-Series Analysis , 1995, The American Naturalist.

[11]  Jeffrey D Sachs,et al.  Incorporating a Rapid-Impact Package for Neglected Tropical Diseases with Programs for HIV/AIDS, Tuberculosis, and Malaria , 2006, PLoS medicine.

[12]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.

[13]  T. Royama,et al.  Analytical Population Dynamics , 1994, Population and Community Biology Series.

[14]  Peter Turchin,et al.  Complex Population Dynamics , 2003 .

[15]  Peter Turchin,et al.  Complex Dynamics in Ecological Time Series , 1992 .

[16]  S. Levin.  THE PROBLEM OF PATTERN AND SCALE IN ECOLOGY , 1992 .

[17]  S I Hay,et al.  Etiology of interepidemic periods of mosquito-borne disease. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[18]  K. Lindblade,et al.  Early Warning of Malaria Epidemics in African Highlands Using Anopheles (Diptera: Culicidae) Indoor Resting Density , 2000, Journal of medical entomology.

[19]  C. A. Kofoid.  The Genesis of Epidemics and the Natural History of Disease , 1929 .

[20]  M. Lindsay,et al.  Development of a predictive model for ross river virus disease in Brisbane, Australia. , 2004, The American journal of tropical medicine and hygiene.

[21]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[22]  L. F. Chaves,et al.  Climate Cycles and Forecasts of Cutaneous Leishmaniasis, a Nonstationary Vector-Borne Disease , 2006, PLoS medicine.

[23]  Prendergast,et al.  The macroecology of population dynamics: taxonomic and biogeographic patterns in population cycles , 1998 .

[24]  M. G. Garner,et al.  Early Warning of Ross River Virus Epidemics: Combining Surveillance Data on Climate and Mosquitoes , 2006, Epidemiology.

[25]  D. Feliciangeli,et al.  Abundance of Lutzomyia ovallesi but not Lu. gomezi (Diptera: Psychodidae) correlated with cutaneous leishmaniasis incidence in north‐central Venezuela , 1998, Medical and veterinary entomology.

[26]  Shilu Tong,et al.  Climate variability and Ross River virus transmission in Townsville Region, Australia, 1985–1996 , 2004, Tropical medicine & international health : TM & IH.

[27]  L. F. Chaves,et al.  Mathematical modelling of American cutaneous leishmaniasis: incidental hosts and threshold conditions for infection persistence. , 2004, Acta tropica.

[28]  T. Clutton‐Brock,et al.  Noise and determinism in synchronized sheep dynamics , 1998, Nature.

[29]  A. Githeko,et al.  Association between climate variability and malaria epidemics in the East African highlands. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  K. Mengersen,et al.  RAINFALL, MOSQUITO DENSITY AND THE TRANSMISSION OF ROSS RIVER VIRUS: A TIME SERIES FORECASTING MODEL , 2005 .

[31]  S. Carpenter,et al.  Ecological forecasts: an emerging imperative. , 2001, Science.

[32]  J. Shaw,et al.  Epidemiology and ecology of leishmaniasis in Latin-America , 1978, Nature.

[33]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[34]  S. Levin.  The problem of pattern and scale in ecology , 1992 .

[35]  William W. Murdoch,et al.  Consumer-resource dynamics , 2003 .

[36]  M C Thomson,et al.  The development of Malaria Early Warning Systems for Africa. , 2001, Trends in parasitology.

[37]  S J De Vlas,et al.  Effects of meteorological factors on epidemic malaria in Ethiopia: a statistical modelling approach based on theoretical reasoning , 2004, Parasitology.

[38]  S. P. Ellner,et al.  Measles as a case study in nonlinear forecasting and chaos , 1994, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[39]  Robert M. May,et al.  Patterns of Dynamical Behaviour in Single-Species Populations , 1976 .

[40]  Simon I Hay,et al.  Forecasting, warning, and detection of malaria epidemics: a case study , 2003, The Lancet.

[41]  S. Hay,et al.  Satellite imagery in the study and forecast of malaria , 2002, Nature.

[42]  R. Shanmugam.  Introduction to Time Series and Forecasting , 1997 .

[43]  Richard Levins,et al.  Strategies of abstraction , 2007 .

[44]  P. Hosseini,et al.  Seasonality and the dynamics of infectious diseases. , 2006, Ecology letters.

[45]  M. Loevinsohn,et al.  Climatic warming and increased malaria incidence in Rwanda , 1994, The Lancet.

[46]  M C Thomson,et al.  Forecasting and prevention of epidemic malaria: new perspectives on an old problem. , 1999, Parassitologia.

[47]  Joel Schwartz,et al.  Weather-based prediction of Plasmodium falciparum malaria in epidemic-prone regions of Ethiopia I. Patterns of lagged weather effects reflect biological mechanisms , 2004, Malaria Journal.

[48]  R. Levins,et al.  Toward an Ecosocial View of Health , 1999, International journal of health services : planning, administration, evaluation.

[49]  Pietro Ceccato,et al.  An online operational rainfall-monitoring resource for epidemic malaria early warning systems in Africa , 2005, Malaria Journal.

[50]  Joel Schwartz,et al.  Weather-based prediction of Plasmodium falciparum malaria in epidemic-prone regions of Ethiopia II. Weather-based prediction systems perform comparably to early detection systems in identifying times for interventions , 2004, Malaria Journal.

[51]  Timothy J. Robinson,et al.  Linear Models With R , 2005, Technometrics.

[52]  M. Pascual.  Understanding nonlinear dynamics , 1996 .

[53]  K. Mengersen,et al.  Rainfall, mosquito density and the transmission of Ross River virus: A time-series forecasting model , 2006 .

[54]  M. Thomson,et al.  Use of rainfall and sea surface temperature monitoring for malaria early warning in Botswana. , 2005, The American journal of tropical medicine and hygiene.

[55]  竹安 数博,et al.  Time series analysis and its applications , 2007 .

[56]  J. Patz,et al.  Impact of regional climate change on human health , 2005, Nature.