A computational model of altered gait patterns in parkinson's disease patients negotiating narrow doorways

We present a computational model of altered gait velocity patterns in Parkinson's Disease (PD) patients. PD gait is characterized by short shuffling steps, reduced walking speed, increased double support time and sometimes increased cadence. The most debilitating symptom of PD gait is the context dependent cessation in gait known as freezing of gait (FOG). Cowie et al. (2010) and Almeida and Lebold (2010) investigated FOG as the changes in velocity profiles of PD gait, as patients walked through a doorway with variable width. The former reported a sharp dip in velocity, a short distance from the doorway that was greater for narrower doorways. They compared the gait performance in PD freezers at ON and OFF dopaminergic medication. In keeping with this finding, the latter also reported the same for ON medicated PD freezers and non-freezers. In the current study, we sought to simulate these gait changes using a computational model of Basal Ganglia based on Reinforcement Learning, coupled with a spinal rhythm mimicking central pattern generator (CPG) model. In the model, a simulated agent was trained to learn a value profile over a corridor leading to the doorway by repeatedly attempting to pass through the doorway. Temporal difference error in value, associated with dopamine signal, was appropriately constrained in order to reflect the dopamine-deficient conditions of PD. Simulated gait under PD conditions exhibited a sharp dip in velocity close to the doorway, with PD OFF freezers showing the largest decrease in velocity compared to PD ON freezers and controls. PD ON and PD OFF freezers both showed sensitivity to the doorway width, with narrow door producing the least velocity/ stride length. Step length variations were also captured with PD freezers producing smaller steps and larger step-variability than PD non-freezers and controls. In addition this model is the first to explain the non-dopamine dependence for FOG giving rise to several other possibilities for its etiology.

[1]  V. S. Chakravarthy,et al.  The Role of the Basal Ganglia in Exploration in a Neural Model Based on Reinforcement Learning , 2006, Int. J. Neural Syst..

[2]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[3]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[4]  Hiroshi Shimizu,et al.  Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment , 1991, Biological Cybernetics.

[5]  Stephen R Lord,et al.  Clinical and physiological assessments for elucidating falls risk in Parkinson's disease , 2009, Movement disorders : official journal of the Movement Disorder Society.

[6]  Ken-ichi Amemori,et al.  Shifting Responsibly: The Importance of Striatal Modularity to Reinforcement Learning in Uncertain Environments , 2011, Front. Hum. Neurosci..

[7]  R. Baldessarini,et al.  Effects of L-dopa on norepinephrine metabolism in the brain. , 1971, Proceedings of the National Academy of Sciences of the United States of America.

[8]  E M Hennig,et al.  Heel to toe motion characteristics in Parkinson patients during free walking. , 2001, Clinical biomechanics.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Junchao Tong,et al.  Preferential loss of serotonin markers in caudate versus putamen in Parkinson's disease. , 2007, Brain : a journal of neurology.

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  S. Rayala,et al.  Nanomedicine: towards development of patient-friendly drug-delivery systems for oncological applications , 2012, International journal of nanomedicine.

[13]  T. Prescott,et al.  The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. , 2010, Progress in Neurobiology.

[14]  S Fahn,et al.  Monoamines in the human neostriatum: topographic distribution in normals and in Parkinson's disease and their role in akinesia, rigidity, chorea, and tremor. , 1971, Journal of the neurological sciences.

[15]  Shun-ichi Amari,et al.  Modeling Basal Ganglia for Understanding Parkinsonian Reaching Movements , 2010, Neural Computation.

[16]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  K. Rommelfanger,et al.  Norepinephrine: The redheaded stepchild of Parkinson's disease. , 2007, Biochemical pharmacology.

[18]  O. Blin,et al.  Visual control of locomotion in Parkinson's disease. , 1999, Brain : a journal of neurology.

[19]  J. Summers,et al.  Abnormalities in the stride length‐cadence relation in parkinsonian gait , 1998, Movement disorders : official journal of the Movement Disorder Society.

[20]  S. Kish,et al.  Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. , 1988, The New England journal of medicine.

[21]  V. Srinivasa Chakravarthy,et al.  On the neural substrates for exploratory dynamics in basal ganglia: A model , 2012, Neural Networks.

[22]  M. Morris,et al.  Postural instability in Parkinson's disease: a comparison with and without a concurrent task. , 2000, Gait & posture.

[23]  Q. Almeida,et al.  Freezing of gait in Parkinson's disease: a perceptual cause for a motor impairment? , 2009, Journal of Neurology, Neurosurgery & Psychiatry.

[24]  RuppinEytan,et al.  Actor-critic models of the basal ganglia , 2002 .

[25]  K. Takakusaki,et al.  Substrates for normal gait and pathophysiology of gait disturbances with respect to the basal ganglia dysfunction , 2008, Journal of Neurology.

[26]  R. Iansek,et al.  Gait freezing in Parkinson's disease and the stride length sequence effect interaction. , 2009, Brain : a journal of neurology.

[27]  B. Scatton,et al.  Parkinson's disease and dementia , 1987, Neurology.

[28]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[29]  V. Srinivasa Chakravarthy,et al.  What do the basal ganglia do? A modeling perspective , 2010, Biological Cybernetics.

[30]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[31]  Udo Rüb,et al.  Where Does Parkinson Disease Pathology Begin in the Brain? , 2002, Journal of neuropathology and experimental neurology.

[32]  J J López-Ibor Serotonin and Psychiatric Disorders , 1992, International clinical psychopharmacology.

[33]  James M Shine,et al.  The specific contributions of set‐shifting to freezing of gait in Parkinson's disease , 2010, Movement disorders : official journal of the Movement Disorder Society.

[34]  Shin Ishii,et al.  Reinforcement Learning for CPG-Driven Biped Robot , 2004, AAAI.

[35]  M. Vaswani,et al.  Role of selective serotonin reuptake inhibitors in psychiatric disorders: a comprehensive review , 2003, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[36]  Saori C. Tanaka,et al.  Serotonin Differentially Regulates Short- and Long-Term Prediction of Rewards in the Ventral and Dorsal Striatum , 2007, PloS one.

[37]  B. Day,et al.  Insights into the neural control of locomotion from walking through doorways in Parkinson's disease , 2010, Neuropsychologia.

[38]  P. Dayan,et al.  Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin , 2010, Neuropsychopharmacology.

[39]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[40]  H Johansen-Berg,et al.  Towards an understanding of gait control: brain activation during the anticipation, preparation and execution of foot movements , 2004, NeuroImage.

[41]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[42]  J. Frank,et al.  Dopaminergic modulation of timing control and variability in the gait of Parkinson's disease , 2007, Movement disorders : official journal of the Movement Disorder Society.

[43]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[44]  R. Wurtman,et al.  Regional effects of L-dihydroxyphenylalanine (L-dopa) on norepinephrine metabolism in rat brain. , 1972, The Journal of pharmacology and experimental therapeutics.

[45]  M. Bozkurt,et al.  Functional anatomy. , 1980, Equine veterinary journal.

[46]  G. Aston-Jones,et al.  Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  A. C. D. P. Filho Application of hybrid van der Pol-Rayleigh oscillators for modeling of a bipedal robot , 2009 .

[48]  N. Yanagisawa,et al.  Cognitive impact on freezing of gait in Parkinson's disease , 2006 .

[49]  D. G. MacKay The Problems of Flexibility, Fluency, and Speed-Accuracy Trade-Off in Skilled Behavior. , 1982 .

[50]  Peter A LeWitt,et al.  Norepinephrine: the next therapeutics frontier for Parkinson's disease , 2012, Translational Neurodegeneration.

[51]  Fatehi Mt,et al.  Ground reaction forces during ambulation in parkinsonism: pilot study. , 1987 .

[52]  Jeffrey M. Hausdorff,et al.  Gait variability and basal ganglia disorders: Stride‐to‐stride variations of gait cycle timing in parkinson's disease and Huntington's disease , 1998, Movement disorders : official journal of the Movement Disorder Society.

[53]  Ludovic Righetti,et al.  Programmable Central Pattern Generators , 2006 .

[54]  Ludovic Righetti,et al.  Programmable central pattern generators: an application to biped locomotion control , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[55]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[56]  Elizabeth J. Bradshaw,et al.  The Speed-Accuracy Trade-Off in Human Gait Control When Running Towards Targets , 2000 .

[57]  V. Russell,et al.  Regional distribution of monoamines and dopamine D1-and D2-receptors in the striatum of the rat , 1992, Neurochemical Research.

[58]  W. Schultz Dopamine signals for reward value and risk: basic and recent data , 2010, Behavioral and Brain Functions.

[59]  R. Dobbs,et al.  Parkinsonian abnormality of foot strike: a phenomenon of ageing and/or one responsive to levodopa therapy? , 1990, British journal of clinical pharmacology.

[60]  R. Rogers The Roles of Dopamine and Serotonin in Decision Making: Evidence from Pharmacological Experiments in Humans , 2011, Neuropsychopharmacology.

[61]  David M. Ludlum An Uneven Pattern , 1984 .

[62]  Mark L. Latash,et al.  Effects of postural task requirements on the speed–accuracy trade-off , 2007, Experimental Brain Research.

[63]  S. Lewis,et al.  A pathophysiological model of freezing of gait in Parkinson's disease. , 2009, Parkinsonism & related disorders.

[64]  R. Lemon Descending pathways in motor control. , 2008, Annual review of neuroscience.