Comparing data mining methods with logistic regression in childhood obesity prediction

The epidemiological question of concern here is “can young children at risk of obesity be identified from their early growth records?” Pilot work using logistic regression to predict overweight and obese children demonstrated relatively limited success. Hence we investigate the incorporation of non-linear interactions to help improve accuracy of prediction; by comparing the result of logistic regression with those of six mature data mining techniques.The contributions of this paper are as follows: a) a comparison of logistic regression with six data mining techniques: specifically, for the prediction of overweight and obese children at 3 years using data recorded at birth, 6 weeks, 8 months and 2 years respectively; b) improved accuracy of prediction: prediction at 8 months accuracy is improved very slightly, in this case by using neural networks, whereas for prediction at 2 years obtained accuracy is improved by over 10%, in this case by using Bayesian methods. It has also been shown that incorporation of non-linear interactions could be important in epidemiological prediction, and that data mining techniques are becoming sufficiently well established to offer the medical research community a valid alternative to logistic regression.

[1]  Lior Rokach,et al.  Top-down induction of decision trees classifiers - a survey , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  T J Cole,et al.  British 1990 growth reference centiles for weight, height, body mass index and head circumference fitted by maximum penalized likelihood. , 1998, Statistics in medicine.

[3]  Clive Osmond,et al.  Relation of serial changes in childhood body-mass index to impaired glucose tolerance in young adulthood. , 2004, The New England journal of medicine.

[4]  Nicolette de Keizer,et al.  Integrating classification trees with local logistic regression in Intensive Care prognosis , 2003, Artif. Intell. Medicine.

[5]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[6]  Remco R. Bouckaert Naive Bayes Classifiers That Perform Well with Continuous Variables , 2004, Australian Conference on Artificial Intelligence.

[7]  B Theodoulidis,et al.  Using T3, an Improved Decision Tree Classifier, for Mining Stroke-related Medical Data , 2007, Methods of Information in Medicine.

[8]  W H Dietz,et al.  Increasing pediatric obesity in the United States. , 1987, American journal of diseases of children.

[9]  Kweku-Muata Osei-Bryson,et al.  Splitting methods for decision tree induction: An exploration of the relative performance of two entropy-based families , 2006, Inf. Syst. Frontiers.

[10]  Ian Witten,et al.  Data Mining , 2000 .

[11]  T J Cole,et al.  Body mass index has risen more steeply in tall than in short 3-year olds: serial cross-sectional surveys 1988–2003 , 2007, International Journal of Obesity.

[12]  Igor Kononenko,et al.  Inductive and Bayesian learning in medical diagnosis , 1993, Appl. Artif. Intell..

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[15]  A Tremblay,et al.  The response to long-term overfeeding in identical twins. , 1990, The New England journal of medicine.

[16]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  K. R. Cohen,et al.  School-based interventions for obesity: Current approaches and future prospects. , 1985 .

[18]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[19]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[20]  J. Ross,et al.  The National Children and Youth Fitness Study II. , 1987 .

[21]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[22]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[23]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[24]  Ruth Solomon,et al.  Training Dancers: Anatomy as a Master Image , 1987 .

[25]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[26]  Usama M. Fayyad,et al.  Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning , 1993, IJCAI.