Indices for performance evaluation of predictive models in food microbiology.

Two complementary measures are proposed as simple indices of the performance of models in predictive food microbiology. The indices assess the level of confidence one can have in the predictions of the model and whether the model displays any bias which could lead to 'fail-dangerous' predictions. The use of the indices is demonstrated using data collated from independent and published literature. This analysis supports previous reports that evaluation of predictive models by comparison to published microbial growth rate data may be inappropriate because of limitations in that data. The indices may fail to reveal some forms of systematic deviation between observed and predicted behaviour. It is concluded, however, that the indices provide an objective and readily interpreted summary of model performance and may serve as a first step towards the development of an objective and useful definition of the term 'validated model' in predictive food microbiology.

[1]  The Growth and Persistence of Staphylococcus aureus in Milk and Broth Substrates , 1965 .

[2]  J. Troller,et al.  INFLUENCE OF WATER ACTIVITY ON GROWTH AND ENTEROTOXIN FORMATION BY Staphylococcus aureus IN FOODS , 1975 .

[3]  D. Kilsby,et al.  Hazard analysis applied to microbial growth in foods: development of mathematical models describing the effect of water activity. , 1983, The Journal of applied bacteriology.

[4]  D. Ratkowsky,et al.  Model for combined effect of temperature and salt concentration/water activity on the growth rate of Staphylococcus xylosus. , 1987, The Journal of applied bacteriology.

[5]  S. Notermans,et al.  Production of enterotoxins and thermonuclease by Staphylococcus aureus in cooked egg-noodles. , 1988, International journal of food microbiology.

[6]  T. A. Roberts,et al.  Predicting microbial growth: growth responses of salmonellae in a laboratory medium as affected by pH, sodium chloride and storage temperature. , 1988, International journal of food microbiology.

[7]  D. Kilsby,et al.  Comparison of the Schoolfield (non-linear Arrhenius) model and the Square Root model for predicting bacterial growth in foods , 1989 .

[8]  Predicting microbial growth: graphical methods for comparing models. , 1990, International journal of food microbiology.

[9]  F. Rombouts,et al.  Modeling of the Bacterial Growth Curve , 1990, Applied and environmental microbiology.

[10]  Tom Ross,et al.  Comparison of Arrhenius‐type and Bêlehrádek‐type models for prediction of bacterial growth in foods , 1991 .

[11]  D W Schaffner,et al.  Evaluation of data transformations used with the square root and schoolfield models for predicting bacterial growth rate , 1992, Applied and environmental microbiology.

[12]  Donald W Schaffner,et al.  Modeling the Effect of Temperature on the Growth Rate and Lag Time of Listeria innocua and Listeria monocytogenes. , 1993, Journal of food protection.

[13]  M H Zwietering,et al.  Modelling bacterial growth of Listeria monocytogenes as a function of water activity, pH and temperature. , 1993, International journal of food microbiology.

[14]  J Baranyi,et al.  A predictive model for the combined effect of pH, sodium chloride and storage temperature on the growth of Brochothrix thermosphacta. , 1993, International journal of food microbiology.

[15]  Tom Ross,et al.  A philosophy for the development of kinetic models in predictive microbiology , 1993 .

[16]  R. Buchanan,et al.  RESPONSE SURFACE MODELS FOR THE EFFECTS OF TEMPERATURE, pH, SODIUM CHLORIDE, AND SODIUM NITRITE ON THE AEROBIC AND ANAEROBIC GROWTH OF STAPHYLOCOCCUS AUREUS 196E , 1993 .

[17]  S. Calderone,et al.  Effect of polyphosphate and sodium chloride on the growth of Listeria monocytogenes and Staphylococcus aureus in ultra-high temperature milk. , 1994, Journal of dairy science.

[18]  M. H. Zwietering,et al.  Evaluation of Data Transformations and Validation of a Model for the Effect of Temperature on Bacterial Growth , 1994, Applied and environmental microbiology.

[19]  T. A. Roberts,et al.  Predictive modelling of growth of Staphylococcus aureus: the effects of temperature, pH and sodium chloride. , 1994, International journal of food microbiology.

[20]  R. Buchanan,et al.  Response surface model of the effect of pH, sodium chloride and sodium nitrite on growth of Yersinia enterocolitica at low temperatures. , 1994, International journal of food microbiology.

[21]  D W Schaffner,et al.  Application of a statistical bootstrapping technique to calculate growth rate variance for modelling psychrotrophic pathogen growth. , 1994, International journal of food microbiology.

[22]  Tom Ross,et al.  Choosing probability distributions for modelling generation time variability , 1996 .