A Neurocomputational Model of the Effect of Cognitive Load on Freezing of Gait in Parkinson's Disease

Experimental data show that perceptual cues can either exacerbate or ameliorate freezing of gait (FOG) in Parkinson's Disease (PD). For example, simple visual stimuli like stripes on the floor can alleviate freezing whereas complex stimuli like narrow doorways can trigger it. We present a computational model of the cognitive and motor cortico-basal ganglia loops that explains the effects of sensory and cognitive processes on FOG. The model simulates strong causative factors of FOG including decision conflict (a disagreement of various sensory stimuli in their association with a response) and cognitive load (complexity of coupling a stimulus with downstream mechanisms that control gait execution). Specifically, the model simulates gait of PD patients (freezers and non-freezers) as they navigate a series of doorways while simultaneously responding to several Stroop word cues in a virtual reality setup. The model is based on an actor-critic architecture of Reinforcement Learning involving Utility-based decision making, where Utility is a weighted sum of Value and Risk functions. The model accounts for the following experimental data: (a) the increased foot-step latency seen in relation to high conflict cues, (b) the high number of motor arrests seen in PD freezers when faced with a complex cue compared to the simple cue, and (c) the effect of dopamine medication on these motor arrests. The freezing behavior arises as a result of addition of task parameters (doorways and cues) and not due to inherent differences in the subject group. The model predicts a differential role of risk sensitivity in PD freezers and non-freezers in the cognitive and motor loops. Additionally this first-of-its-kind model provides a plausible framework for understanding the influence of cognition on automatic motor actions in controls and Parkinson's Disease.

[1]  Jorik Nonnekes,et al.  Freezing of gait: a practical approach to management , 2015, The Lancet Neurology.

[2]  Balaraman Ravindran,et al.  A network model of basal ganglia for understanding the roles of dopamine and serotonin in reward-punishment-risk based decision making , 2015, Front. Comput. Neurosci..

[3]  Colin G. Ellard,et al.  Does Anxiety Cause Freezing of Gait in Parkinson's Disease? , 2014, PloS one.

[4]  Jeffery A. Jones,et al.  Motor planning in Parkinson’s disease patients experiencing freezing of gait: The influence of cognitive load when approaching obstacles , 2014, Brain and Cognition.

[5]  Balaraman Ravindran,et al.  An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning , 2014, Front. Comput. Neurosci..

[6]  V. Srinivasa Chakravarthy,et al.  A computational model of altered gait patterns in parkinson's disease patients negotiating narrow doorways , 2014, Front. Comput. Neurosci..

[7]  V. Srinivasa Chakravarthy,et al.  Computational model of precision grip in Parkinson's disease: a utility based approach , 2013, Front. Comput. Neurosci..

[8]  Michael J Frank,et al.  Freezing of gait in Parkinson's disease is associated with functional decoupling between the cognitive control network and the basal ganglia. , 2013, Brain : a journal of neurology.

[9]  Elie Matar,et al.  Using virtual reality to explore the role of conflict resolution and environmental salience in freezing of gait in Parkinson's disease. , 2013, Parkinsonism & related disorders.

[10]  S T Moore,et al.  Modeling freezing of gait in Parkinson's disease with a virtual reality paradigm. , 2013, Gait & posture.

[11]  J. Shine,et al.  Exploring the cortical and subcortical functional magnetic resonance imaging changes associated with freezing in Parkinson's disease. , 2013, Brain : a journal of neurology.

[12]  T. Boraud,et al.  Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study. , 2013, Journal of neurophysiology.

[13]  J. Shine,et al.  Differential Neural Activation Patterns in Patients with Parkinson's Disease and Freezing of Gait in Response to Concurrent Cognitive and Motor Load , 2013, PloS one.

[14]  E. Soetens,et al.  Freezing of gait in Parkinson's disease: disturbances in automaticity and control , 2013, Front. Hum. Neurosci..

[15]  V. Srinivasa Chakravarthy,et al.  On the neural substrates for exploratory dynamics in basal ganglia: A model , 2012, Neural Networks.

[16]  M. Hallett,et al.  Freezing of gait: moving forward on a mysterious clinical phenomenon , 2011, The Lancet Neurology.

[17]  Eric Soetens,et al.  Freezing of Gait in Parkinson Disease Is Associated With Impaired Conflict Resolution , 2011, Neurorehabilitation and neural repair.

[18]  Kaat Desloovere,et al.  Freezing of gait in Parkinson's disease: The impact of dual‐tasking and turning , 2010, Movement disorders : official journal of the Movement Disorder Society.

[19]  Shun-ichi Amari,et al.  Modeling Basal Ganglia for Understanding Parkinsonian Reaching Movements , 2010, Neural Computation.

[20]  V. Srinivasa Chakravarthy,et al.  What do the basal ganglia do? A modeling perspective , 2010, Biological Cybernetics.

[21]  Camille A. Bonnin,et al.  Adjustments of conflict monitoring in Parkinson's disease. , 2010, Neuropsychology.

[22]  B. Day,et al.  Insights into the neural control of locomotion from walking through doorways in Parkinson's disease , 2010, Neuropsychologia.

[23]  K. R. Ridderinkhof,et al.  Conscious perception of errors and its relation to the anterior insula , 2010, Brain Structure and Function.

[24]  Jeffrey M. Hausdorff,et al.  Properties of the ‘Timed Up and Go’ Test: More than Meets the Eye , 2010, Gerontology.

[25]  W. Schultz Dopamine signals for reward value and risk: basic and recent data , 2010, Behavioral and Brain Functions.

[26]  Jeffrey M. Hausdorff,et al.  Can an accelerometer enhance the utility of the Timed Up & Go Test when evaluating patients with Parkinson's disease? , 2010, Medical engineering & physics.

[27]  Nir Giladi,et al.  Obstacle avoidance to elicit freezing of gait during treadmill walking , 2010, Movement disorders : official journal of the Movement Disorder Society.

[28]  Zhong-Lin Lu,et al.  Neural correlates of risk prediction error during reinforcement learning in humans , 2009, NeuroImage.

[29]  Q. Almeida,et al.  Freezing of gait in Parkinson's disease: a perceptual cause for a motor impairment? , 2009, Journal of Neurology, Neurosurgery & Psychiatry.

[30]  S. Lewis,et al.  A pathophysiological model of freezing of gait in Parkinson's disease. , 2009, Parkinsonism & related disorders.

[31]  Fay B. Horak,et al.  Knee trembling during freezing of gait represents multiple anticipatory postural adjustments , 2009, Experimental Neurology.

[32]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[33]  Junchao Tong,et al.  Preferential loss of serotonin markers in caudate versus putamen in Parkinson's disease. , 2007, Brain : a journal of neurology.

[34]  B. Bloem,et al.  The “posture second” strategy: A review of wrong priorities in Parkinson's disease , 2006, Journal of the Neurological Sciences.

[35]  Jeffrey M. Hausdorff,et al.  Dual‐tasking effects on gait variability: The role of aging, falls, and executive function , 2006, Movement disorders : official journal of the Movement Disorder Society.

[36]  V. S. Chakravarthy,et al.  The Role of the Basal Ganglia in Exploration in a Neural Model Based on Reinforcement Learning , 2006, Int. J. Neural Syst..

[37]  Jeffrey M. Hausdorff,et al.  Dual tasking, gait rhythmicity, and Parkinson's disease: Which aspects of gait are attention demanding? , 2005, The European journal of neuroscience.

[38]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[39]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[40]  Jeffrey M. Hausdorff,et al.  Falls and freezing of gait in Parkinson's disease: A review of two interconnected, episodic phenomena , 2004, Movement disorders : official journal of the Movement Disorder Society.

[41]  Nir Giladi,et al.  Characterization of freezing of gait subtypes and the response of each to levodopa in Parkinson's disease , 2003, European journal of neurology.

[42]  D. Bub,et al.  Task switching deficits associated with Parkinson’s disease reflect depleted attentional resources , 2002, Neuropsychologia.

[43]  M. Merello,et al.  [Functional anatomy of the basal ganglia]. , 2000, Revista de neurologia.

[44]  A. Graybiel The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[45]  Jeffrey M. Hausdorff,et al.  Gait variability and basal ganglia disorders: Stride‐to‐stride variations of gait cycle timing in parkinson's disease and Huntington's disease , 1998, Movement disorders : official journal of the Movement Disorder Society.

[46]  J. Summers,et al.  Abnormalities in the stride length‐cadence relation in parkinsonian gait , 1998, Movement disorders : official journal of the Movement Disorder Society.

[47]  A. Parent,et al.  Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop , 1995, Brain Research Reviews.

[48]  D. E. Bell Risk, return, and utility , 1995 .

[49]  Satoshi Takahashi,et al.  Concentrations of serotonin and its related substances in the cerebrospinal fluid of Parkinsonian patients and their relations to the severity of symptoms , 1993, Neuroscience Letters.

[50]  Colin M. Macleod Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[51]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[52]  S. Kish,et al.  Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. , 1988, The New England journal of medicine.

[53]  C. Marsden,et al.  Internal versus external cues and the control of attention in Parkinson's disease. , 1988, Brain : a journal of neurology.

[54]  A. Treisman,et al.  The Stroop Test: Selective Attention to Colours and Words , 1969, Nature.

[55]  V. S. Chakravarthy,et al.  The Basal Ganglia System as an Engine for Exploration , 2018 .

[56]  V. Srinivasa Chakravarthy,et al.  Basal Ganglia System as an Engine for Exploration , 2014, Encyclopedia of Computational Neuroscience.

[57]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[58]  Nir Giladi,et al.  Freezing of gait in patients with advanced Parkinson's disease , 2001, Journal of Neural Transmission.

[59]  M. Raichle,et al.  The anterior cingulate cortex mediates processing selection in the Stroop attentional conflict paradigm. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[60]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.