Convolutional neural network reveals frequency content of medio-lateral COM body sway to be highly predictive of Parkinson's disease

Postural instability as a symptom of progressing Parkinson's disease (PD) greatly reduces quality of life. Hence, early detection of postural impairments is crucial to facilitate interventions. Our aim was to use a convolutional neural network (CNN) to differentiate people with early to mid-stage PD from healthy age-matched individuals based on spectrogram images obtained from their body movement. We hypothesized the time-frequency content of body sway to be predictive of PD, even when impairments are not yet manifested in day-to-day postural control. We tracked their center of pressure (COP) using a Wii Balance Board and their full-body motion using a Microsoft Kinect, out of which we calculated the trajectory of their center of mass (COM). We used 30 s-snippets of motion data from which we acquired wavelet-based time-frequency spectrograms that were fed into a custom-built CNN as labeled images. We used binary classification to have the network differentiate between individuals with PD and controls (n=15, respectively). Classification performance was best when the medio-lateral motion of the COM was considered. Here, our network reached an average predictive accuracy of 98.45 % with a receiver operating characteristic area under the curve of 1.0. Moreover, an explainable AI approach revealed high frequencies in the postural sway data to be most distinct between both groups. Our findings suggest a CNN classifier based on cost-effective and conveniently obtainable posturographic data to be a promising approach to detect postural impairments in early to mid-stage PD and to gain novel insight into the subtle characteristics of impairments at this stage of the disease.

[1]  B. Pueo,et al.  The Use of the Static Posturography to Assess Balance Performance in a Parkinson’s Disease Population , 2023, International journal of environmental research and public health.

[2]  Jamie L. Adams,et al.  Monitoring gait at home with radio waves in Parkinson’s disease: A marker of severity, progression, and medication response , 2022, Science Translational Medicine.

[3]  Linga Reddy Cenkeramaddi,et al.  Lightweight deep convolutional neural network for background sound classification in speech signals. , 2022, The Journal of the Acoustical Society of America.

[4]  F. Bremmer,et al.  Visual Perturbation Suggests Increased Effort to Maintain Balance in Early Stages of Parkinson’s to be an Effect of Age Rather Than Disease , 2022, Frontiers in Human Neuroscience.

[5]  J. Lou,et al.  Early Detection of Parkinson’s Disease Using Center of Pressure Data and Machine Learning , 2021, 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[6]  Jakob C. B. Schwenk,et al.  Visual perturbation of balance suggests impaired motor control but intact visuo-motor processing in Parkinson's disease. , 2021, Journal of neurophysiology.

[7]  M. Fernández-Del-Olmo,et al.  Test-Retest Reliability of the Timed Up and Go Test in Subjects with Parkinson's Disease: Implications for Longitudinal Assessments. , 2021, Journal of Parkinson's disease.

[8]  U. Acharya,et al.  GaborPDNet: Gabor Transformation and Deep Neural Network for Parkinson’s Disease Detection Using EEG Signals , 2021, Electronics.

[9]  S. K. Khare,et al.  PDCNNet: An Automatic Framework for the Detection of Parkinson’s Disease Using EEG Signals , 2021, IEEE Sensors Journal.

[10]  Christian Desrosiers,et al.  Machine Learning for the Diagnosis of Parkinson's Disease: A Review of Literature , 2021, Frontiers in Aging Neuroscience.

[11]  Jakob C. B. Schwenk,et al.  Multi-segment phase coupling to oscillatory visual drive. , 2021, Gait & posture.

[12]  Shuqi Zhang,et al.  Automated Classification of Postural Control for Individuals With Parkinson's Disease Using a Machine Learning Approach: A Preliminary Study. , 2020, Journal of applied biomechanics.

[13]  Sindhu Preetham Burugupally,et al.  Postural Instability in Parkinson’s Disease: A Review , 2019, Brain sciences.

[14]  Bastiaan R Bloem,et al.  Measuring Parkinson's disease over time: The real‐world within‐subject reliability of the MDS‐UPDRS , 2019, Movement disorders : official journal of the Movement Disorder Society.

[15]  Jinwook Kim,et al.  Deep Neural Network-Based Gait Classification Using Wearable Inertial Sensor Data , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  K. Słomka,et al.  A posturographic procedure assessing balance disorders in Parkinson’s disease: a systematic review , 2018, Clinical interventions in aging.

[17]  K. Jellinger,et al.  Lateralisation in Parkinson disease , 2018, Cell and Tissue Research.

[18]  Thurmon E. Lockhart,et al.  Motor Subtypes of Parkinson’s Disease Can Be Identified by Frequency Component of Postural Stability , 2018, Sensors.

[19]  Sung Wook Baik,et al.  Speech Emotion Recognition from Spectrograms with Deep Convolutional Neural Network , 2017, 2017 International Conference on Platform Technology and Service (PlatCon).

[20]  Remigiusz Sokołowski,et al.  Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis. , 2016, Psychiatria polska.

[21]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Jasmine L Mirdamadi,et al.  Cerebellar role in Parkinson's disease. , 2016, Journal of neurophysiology.

[23]  C. Aquino,et al.  Changes in postural control in patients with Parkinson's disease: a posturographic study. , 2016, Physiotherapy.

[24]  Sumit Sarkar,et al.  Neuroprotective and Therapeutic Strategies against Parkinson’s Disease: Recent Perspectives , 2016, International journal of molecular sciences.

[25]  T. Kiemel,et al.  A central processing sensory deficit with Parkinson’s disease , 2016, Experimental Brain Research.

[26]  Thierry Paillard,et al.  Techniques and Methods for Testing the Postural Function in Healthy and Pathological Subjects , 2015, BioMed research international.

[27]  G. Deuschl,et al.  MDS clinical diagnostic criteria for Parkinson's disease , 2015, Movement disorders : official journal of the Movement Disorder Society.

[28]  B. Bloem,et al.  Interventions for preventing falls in Parkinson's disease , 2015 .

[29]  Andrew C Laing,et al.  The influence of ankle muscle activation on postural sway during quiet stance. , 2014, Gait & posture.

[30]  M. Hallett,et al.  The cerebellum in Parkinson’s disease , 2013, Brain : a journal of neurology.

[31]  Natalie E. Allen,et al.  Postural Instability in Patients with Parkinson’s Disease , 2013, CNS Drugs.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  R. Walker,et al.  The management of Parkinson's disease in sub-Saharan Africa , 2012, Expert review of neurotherapeutics.

[34]  Rajesh Pahwa,et al.  Postural Sway in Patients with Mild to Moderate Parkinson's Disease , 2011, The International journal of neuroscience.

[35]  J. Błaszczyk,et al.  Assessment of postural control in patients with Parkinson's disease: sway ratio analysis. , 2011, Human movement science.

[36]  B. Bloem,et al.  Postural instability in Parkinson’s disease: the adrenergic hypothesis and the locus coeruleus , 2009, Expert review of neurotherapeutics.

[37]  M. Vaugoyeau,et al.  Postural disorders in Parkinson’s disease , 2008, Neurophysiologie Clinique/Clinical Neurophysiology.

[38]  J. Jankovic,et al.  Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing results , 2008, Movement disorders : official journal of the Movement Disorder Society.

[39]  M. Landers,et al.  Postural Instability in Idiopathic Parkinson’s Disease: Discriminating Fallers from Nonfallers Based on Standardized Clinical Measures , 2008, Journal of neurologic physical therapy : JNPT.

[40]  A. Beuter,et al.  Postural Sway and Effect of Levodopa in Early Parkinson's Disease , 2008, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[41]  Jacques Weber,et al.  Discordance between measured postural instability and absence of clinical symptoms in Parkinson's disease patients in the early stages of the disease , 2008, Movement disorders : official journal of the Movement Disorder Society.

[42]  J. Nutt,et al.  Disease progression, drug action and Parkinson’s disease: Why time cannot be ignored , 2008, European Journal of Clinical Pharmacology.

[43]  G. Opala,et al.  Assessment of postural instability in patients with Parkinson’s disease , 2007, Experimental Brain Research.

[44]  F. Horak,et al.  Abnormal proprioceptive-motor integration contributes to hypometric postural responses of subjects with parkinson’s disease , 2006, Neuroscience.

[45]  H. Bergman,et al.  Basal ganglia oscillations and pathophysiology of movement disorders , 2006, Current Opinion in Neurobiology.

[46]  Marco Schieppati,et al.  Balance in Parkinson's disease under static and dynamic conditions , 2006, Movement disorders : official journal of the Movement Disorder Society.

[47]  R. Djaldetti,et al.  The mystery of motor asymmetry in Parkinson's disease , 2006, The Lancet Neurology.

[48]  F. Horak Postural orientation and equilibrium: what do we need to know about neural control of balance to prevent falls? , 2006, Age and ageing.

[49]  G. Deuschl,et al.  Scales in Parkinson’s disease , 2006, Journal of Neurology.

[50]  L. Dibble,et al.  Predicting Falls In Individuals with Parkinson Disease: A Reconsideration of Clinical Balance Measures , 2006, Journal of neurologic physical therapy : JNPT.

[51]  Angelo Cappello,et al.  Identification of distinct characteristics of postural sway in Parkinson's disease: A feature selection procedure based on principal component analysis , 2006, Neuroscience Letters.

[52]  C. Gielen,et al.  Differential progression of proprioceptive and visual information processing deficits in Parkinson's disease , 2005, The European journal of neuroscience.

[53]  A. Berardelli,et al.  Sensorimotor integration in movement disorders , 2003, Movement disorders : official journal of the Movement Disorder Society.

[54]  A. Siderowf,et al.  Test–Retest reliability of the Unified Parkinson's Disease Rating Scale in patients with early Parkinson's disease: Results from a multicenter clinical trial , 2002, Movement disorders : official journal of the Movement Disorder Society.

[55]  S. Grill Postural instability in Parkinson's disease. , 1999, Maryland medical journal.

[56]  C. J. Luca,et al.  Open-loop and closed-loop postural control mechanisms in Parkinson's disease: increased mediolateral activity during quiet standing , 1995, Neuroscience Letters.

[57]  M. Hoehn,et al.  Parkinsonism , 1967, Neurology.

[58]  M. Okun,et al.  Detection of postural control in early Parkinson's disease: Clinical testing vs. modulation of center of pressure. , 2021, PloS one.

[59]  Torsten Bumgarner,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[60]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[61]  Katunina Ea,et al.  [Epidemiology of Parkinson's disease]. , 2013, Zhurnal nevrologii i psikhiatrii imeni S.S. Korsakova.