Revealing posturographic features associated with the risk of falling in patients with Parkinsonian syndromes via machine learning

Falling in Parkinsonian syndromes (PS) is associated with postural instability and consists a common cause of disability among PS patients. Current posturographic practices record the body's center-of-pressure displacement (statokinesigram) while the patient stands on a force platform. Statokinesigrams, after appropriate signal processing, can offer numerous posturographic features, which however challenges the efforts for valid statistics via standard univariate approaches. In this work, we present the ts-AUC, a non-parametric multivariate two-sample test, which we employ to analyze statokinesigram differences among PS patients that are fallers (PSf) and non-fallers (PSNF). We included 123 PS patients who were classified into PSF or PSNF based on clinical assessment and underwent simple Romberg Test (eyes open/eyes closed). We analyzed posturographic features using both multiple testing with p-value adjustment and the ts-AUC. While the ts-AUC showed significant difference between groups (p-value = 0.01), multiple testing did not show any such difference. Interestingly, significant difference between the two groups was found only using the open-eyes protocol. PSF showed significantly increased antero-posterior movements as well as increased posturographic area, compared to PSNF. Our study demonstrates the superiority of the ts-AUC test compared to standard statistical tools in distinguishing PSF and PSNF in the multidimensional feature space. This result highlights more generally the fact that machine learning-based statistical tests can be seen as a natural extension of classical statistical approaches and should be considered, especially when dealing with multifactorial assessments.

[1]  Tamara L. Hayes,et al.  Validating and Calibrating the Nintendo Wii Balance Board to Derive Reliable Center of Pressure Measures , 2014, Sensors.

[2]  Michael King,et al.  Trap of trends to statistical significance: likelihood of near significant P value becoming more significant with extra data , 2014, BMJ : British Medical Journal.

[3]  Dan Roth,et al.  Generalization Bounds for the Area Under the ROC Curve , 2005, J. Mach. Learn. Res..

[4]  G. Opala,et al.  Assessment of postural instability in patients with Parkinson’s disease , 2007, Experimental Brain Research.

[5]  Lorenzo Chiari,et al.  ISway: a sensitive, valid and reliable measure of postural control , 2012, Journal of NeuroEngineering and Rehabilitation.

[6]  Mark Speechley,et al.  Defining a fall and reasons for falling: comparisons among the views of seniors, health care providers, and the research literature. , 2006, The Gerontologist.

[7]  Gábor Lugosi,et al.  Ranking and Scoring Using Empirical Risk Minimization , 2005, COLT.

[8]  E. Finkelstein,et al.  The costs of fatal and non-fatal falls among older adults , 2006, Injury Prevention.

[9]  Jean-Michel Poggi,et al.  Variable selection using random forests , 2010, Pattern Recognit. Lett..

[10]  T. Perneger What's wrong with Bonferroni adjustments , 1998, BMJ.

[11]  Nicolas Vayatis,et al.  Balance Impairment in Radiation Induced Leukoencephalopathy Patients Is Coupled With Altered Visual Attention in Natural Tasks , 2019, Front. Neurol..

[12]  Alexander J. Smola,et al.  Generative Models and Model Criticism via Optimized Maximum Mean Discrepancy , 2016, ICLR.

[13]  Clinton T. Rubin,et al.  Dynamic Parameters of Balance Which Correlate to Elderly Persons with a History of Falls , 2013, PloS one.

[14]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[15]  M H Cole,et al.  Predictors of future falls in Parkinson disease , 2010, Neurology.

[16]  I. Melzer,et al.  Postural stability in the elderly: a comparison between fallers and non-fallers. , 2004, Age and ageing.

[17]  Matthew S. Thiese,et al.  The misuse and abuse of statistics in biomedical research , 2015, Biochemia medica.

[18]  Stéphan Clémençon,et al.  AUC optimization and the two-sample problem , 2009, NIPS.

[19]  Paul McCrory,et al.  Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. , 2010, Gait & posture.

[20]  Silke Janitza,et al.  On the overestimation of random forest’s out-of-bag error , 2018, PloS one.

[21]  F. Horak,et al.  Postural sway as a marker of progression in Parkinson's disease: a pilot longitudinal study. , 2012, Gait & posture.

[22]  Stephen R Lord,et al.  Clinical and physiological assessments for elucidating falls risk in Parkinson's disease , 2009, Movement disorders : official journal of the Movement Disorder Society.

[23]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[24]  Elena Oggero,et al.  Biomedical instruments versus toys:a preliminary comparison of force platforms and the nintendo wii balance board - biomed 2011. , 2011, Biomedical sciences instrumentation.

[25]  Francesco Pierelli,et al.  Balance Dysfunction in Parkinson's Disease , 2015, BioMed research international.

[26]  Eling D de Bruin,et al.  Falls prediction in elderly people: a 1-year prospective study. , 2010, Gait & posture.

[27]  L. Breiman OUT-OF-BAG ESTIMATION , 1996 .

[28]  Marcus B. Stone,et al.  Center-of-pressure parameters used in the assessment of postural control , 2002 .

[29]  M. Tinetti Clinical practice. Preventing falls in elderly persons. , 2003, The New England journal of medicine.

[30]  Raija Korpelainen,et al.  Postural sway and falls in Parkinson's disease: A regression approach , 2007, Movement disorders : official journal of the Movement Disorder Society.

[31]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[32]  Mehryar Mohri,et al.  AUC Optimization vs. Error Rate Minimization , 2003, NIPS.

[33]  Julien Audiffren,et al.  On the importance of local dynamics in statokinesigram: A multivariate approach for postural control evaluation in elderly , 2018, PloS one.

[34]  Julien Audiffren,et al.  Preprocessing the Nintendo Wii Board Signal to Derive More Accurate Descriptors of Statokinesigrams , 2016, Sensors.

[35]  R. Feise Do multiple outcome measures require p-value adjustment? , 2002, BMC medical research methodology.

[36]  Shirley Rietdyk,et al.  Multiple timescales in postural dynamics associated with vision and a secondary task are revealed by wavelet analysis , 2009, Experimental Brain Research.

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[38]  Z. Šidák Rectangular Confidence Regions for the Means of Multivariate Normal Distributions , 1967 .

[39]  Julien Audiffren,et al.  A Non Linear Scoring Approach for Evaluating Balance: Classification of Elderly as Fallers and Non-Fallers , 2016, PloS one.

[40]  Maurizio Patrignani,et al.  We-Measure: Toward a low-cost portable posturography for patients with multiple sclerosis using the commercial Wii balance board , 2015, Journal of the Neurological Sciences.