Prediction of influenza vaccination outcome by neural networks and logistic regression

The major challenge in influenza vaccination is to predict vaccine efficacy. The purpose of this study was to design a model to enable successful prediction of the outcome of influenza vaccination based on real historical medical data. A non-linear neural network approach was used, and its performance compared to logistic regression. The three neural network algorithms were tested: multilayer perceptron, radial basis and probabilistic in conjunction with parameter optimization and regularization techniques in order to create an influenza vaccination model that could be used for prediction purposes in the medical practice of primary health care physicians, where the vaccine is usually dispensed. The selection of input variables was based on a model of the vaccine strain which has frequently been changed and on which a poor influenza vaccine response is expected. The performance of models was measured by the average hit rate of negative and positive vaccine outcome. In order to test the generalization ability of the models, a 10-fold cross-validation procedure revealed that the model obtained by multilayer perceptron produced the highest average hit rate among neural network algorithms, and also outperformed the logistic regression model with regard to sensitivity and specificity. Sensitivity analysis was performed on the best model and the importance of input variables was discussed. Further research should focus on improving the performance of the model by combining neural networks with other intelligent methods in this field.

[1]  Shuangzhe Liu,et al.  Global Sensitivity Analysis: The Primer by Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, Stefano Tarantola , 2008 .

[2]  C E Floyd,et al.  The Effect of Data Sampling on the Performance Evaluation of Artificial Neural Networks in Medical Diagnosis , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[4]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[5]  Harvey M. Wagner,et al.  Global Sensitivity Analysis , 1995, Oper. Res..

[6]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[7]  K. Vedhara,et al.  Chronic stress in elderly carers of dementia patients and antibody response to influenza vaccination , 1999, The Lancet.

[8]  Paulo J. G. Lisboa,et al.  The Use of Artificial Neural Networks in Decision Support in Cancer: a Systematic Review , 2005 .

[9]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[10]  A Ziegler,et al.  Two Models for Outcome Prediction , 2006, Methods of Information in Medicine.

[11]  Peter Stenvinkel,et al.  The malnutrition, inflammation, and atherosclerosis (MIA) syndrome -- the heart of the matter. , 2002, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[12]  Gregory A. Poland,et al.  Emerging vaccines for influenza , 2008, Expert opinion on emerging drugs.

[13]  M. Blaser,et al.  Heightened inflammatory response and cytokine expression in vivo to cagA+ Helicobacter pylori strains. , 1995, Laboratory investigation; a journal of technical methods and pathology.

[14]  D. Fuchs,et al.  Moderate hyperhomocysteinemia and immune activation. , 2004, Current pharmaceutical biotechnology.

[15]  Yong Liu,et al.  Unbiased estimate of generalization error and model selection in neural network , 1995, Neural Networks.

[16]  Sun-Young Kim,et al.  Cost-Effectiveness Analyses of Vaccination Programmes , 2012, PharmacoEconomics.

[17]  R. Tripp,et al.  Recombinant vaccines for influenza virus. , 2008, Current opinion in investigational drugs.

[18]  Yoshio Hirota,et al.  Immune response to influenza vaccine in healthy adults and the elderly: association with nutritional status. , 2005, Vaccine.

[19]  G. Nergizoğlu,et al.  Thyroid disorders in hemodialysis patients in an iodine-deficient community. , 2005, Artificial organs.

[20]  Timothy Masters,et al.  Advanced algorithms for neural networks: a C++ sourcebook , 1995 .

[21]  T Aso,et al.  Homocysteine Induces Programmed Cell Death in Human Vascular Endothelial Cells through Activation of the Unfolded Protein Response* , 2001, The Journal of Biological Chemistry.

[22]  C. Ruini,et al.  Life events in the pathogenesis of hyperprolactinemia. , 2004, European journal of endocrinology.

[23]  Branko Soucek Neural and Intelligent Systems Integration , 1991 .

[24]  S. Fullerton,et al.  Dissecting complex disease: the quest for the Philosopher's Stone? , 2006, International journal of epidemiology.

[25]  D. Fuchs,et al.  Moderate hyperhomocysteinaemia and immune activation in Parkinson's disease , 2002, Journal of Neural Transmission.

[26]  M. Arias,et al.  B lymphopenia in uremia is related to an accelerated in vitro apoptosis and dysregulation of Bcl-2. , 2000, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[27]  K. Robinson,et al.  Homocysteine and renal disease. , 2000, Seminars in thrombosis and hemostasis.

[28]  A. Bird,et al.  Epigenetic regulation of gene expression: how the genome integrates intrinsic and environmental signals , 2003, Nature Genetics.

[29]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[30]  H. Sacks,et al.  The Efficacy of Influenza Vaccine in Elderly Persons , 1995, Annals of Internal Medicine.

[31]  Nicolaos B. Karayiannis,et al.  Growing radial basis neural networks: merging supervised and unsupervised learning with network growth techniques , 1997, IEEE Trans. Neural Networks.

[32]  R B Couch,et al.  Efficacy of sequential annual vaccination with inactivated influenza virus vaccine. , 1988, American journal of epidemiology.

[33]  Samuel Patz,et al.  Homocysteine and B vitamins relate to brain volume and white-matter changes in geriatric patients with psychiatric disorders. , 2004, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[34]  Luca Cravello,et al.  Stress and dementia: the role of the hypothalamic-pituitary-adrenal axis , 2006, Aging clinical and experimental research.

[35]  Claudia Sardu,et al.  The link between thyroid autoimmunity (antithyroid peroxidase autoantibodies) with anxiety and mood disorders in the community: a field of interest for public health in the future , 2004, BMC psychiatry.

[36]  G. delle Fave,et al.  Atrophic body gastritis in patients with autoimmune thyroid disease: an underdiagnosed association. , 1999, Archives of internal medicine.

[37]  A. Osterhaus,et al.  Effects of repeated annual influenza vaccination on vaccine sero-response in young and elderly adults. , 1996, Vaccine.

[38]  Douglas Carroll,et al.  Life events, perceived stress and antibody response to influenza vaccination in young, healthy adults. , 2003, Journal of psychosomatic research.

[39]  P. Sipponen,et al.  Prevalence of low vitamin B12 and high homocysteine in serum in an elderly male population: association with atrophic gastritis and Helicobacter pylori infection , 2003, Scandinavian journal of gastroenterology.

[40]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[41]  J Kovarik,et al.  Abnormalities in the hypothalamic-pituitary-adrenocortical axis in patients with chronic renal failure. , 1987, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[42]  Branko Soucek Neural and intelligent systems integration - fifth and sixth generation integrated reasoning information systems , 1991, Sixth-generation computer technology series.

[43]  Cécile Viboud,et al.  Antibody response to influenza vaccination in the elderly: a quantitative review. , 2006, Vaccine.

[44]  J Hilden Neural Networks and the Roles of Cross Validation , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[45]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[46]  E. J Remarque Influenza vaccination in elderly people , 1999, Experimental Gerontology.

[47]  P. Isaacson,et al.  Immunoglobulin specificity of low grade B cell gastrointestinal lymphoma of mucosa-associated lymphoid tissue (MALT) type. , 1993, The American journal of pathology.

[48]  N. Horseman,et al.  The roles of prolactin, growth hormone, insulin-like growth factor-I, and thyroid hormones in lymphocyte development and function: insights from genetic models of hormone and hormone receptor deficiency. , 2000, Endocrine reviews.