Dissociating dynamic probability and predictability in observed actions—an fMRI study

The present fMRI study investigated whether human observers spontaneously exploit the statistical structure underlying continuous action sequences. In particular, we tested whether two different statistical properties can be distinguished with regard to their neural correlates: an action step's predictability and its probability. To assess these properties we used measures from information theory. Predictability of action steps was operationalized by its inverse, conditional entropy, which combines the number of possible action steps with their respective probabilities. Probability of action steps was assessed using conditional surprisal, which increases with decreasing probability. Participants were trained in an action observation paradigm with video clips showing sequences of 9–33 s length with varying numbers of action steps that were statistically structured according to a Markov chain. Behavioral tests revealed that participants implicitly learned this statistical structure, showing that humans are sensitive toward these probabilistic regularities. Surprisal (lower probability) enhanced the BOLD signal in the anterior intraparietal sulcus. In contrast, high conditional entropy, i.e., low predictability, was correlated with higher activity in dorsomedial prefrontal cortex, orbitofrontal gyrus, and posterior intraparietal sulcus. Furthermore, we found a correlation between the anterior hippocampus' response to conditional entropy with the extent of learning, such that the more participants had learnt the structure, the greater the magnitude of hippocampus activation in response to conditional entropy. Findings show that two aspects of predictions can be dissociated: an action's predictability is reflected in a top-down modulation of attentional focus, evident in increased fronto-parietal activation. In contrast, an action's probability depends on the identity of the stimulus itself, resulting in bottom-up driven processing costs in the parietal cortex.

[1]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  Anne Springer,et al.  Predicting and memorizing observed action: Differential premotor cortex involvement , 2011, Human brain mapping.

[3]  G. McCarthy,et al.  Decisions under Uncertainty: Probabilistic Context Influences Activation of Prefrontal and Parietal Cortices , 2005, The Journal of Neuroscience.

[4]  S. Michael Malinconico,et al.  Decisions under Uncertainty. , 1984 .

[5]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[6]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[7]  Timothy E. J. Behrens,et al.  Perceptual Classification in a Rapidly Changing Environment , 2011, Neuron.

[8]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[9]  Jordan B. Peterson,et al.  Psychological entropy: a framework for understanding uncertainty-related anxiety. , 2012, Psychological review.

[10]  D. Yves von Cramon,et al.  The Case of Pretense: Observing Actions and Inferring Goals , 2009, Journal of Cognitive Neuroscience.

[11]  Eric J. Johnson,et al.  Decisions Under Uncertainty: Psychological, Economic, and Neuroeconomic Explanations of Risk Preference , 2009 .

[12]  Y. Kareev,et al.  The emergence of events , 1994, Cognition.

[13]  Ricarda I Schubotz,et al.  Neural changes when actions change: Adaptation of strong and weak expectations , 2013, Human brain mapping.

[14]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[15]  T. Asano,et al.  ENTROPY , RELATIVE ENTROPY , AND MUTUAL INFORMATION , 2008 .

[16]  Marvin M. Chun,et al.  Neural Evidence of Statistical Learning: Efficient Detection of Visual Regularities Without Awareness , 2009, Journal of Cognitive Neuroscience.

[17]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[18]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[19]  A. Schaefer,et al.  Uncertainty and Cognitive Control , 2011, Front. Psychology.

[20]  N. Daw,et al.  Dissociating hippocampal and striatal contributions to sequential prediction learning , 2012, The European journal of neuroscience.

[21]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[22]  P. Perruchet,et al.  Implicit learning and statistical learning: one phenomenon, two approaches , 2006, Trends in Cognitive Sciences.

[23]  Uri Hasson,et al.  Multiple sensitivity profiles to diversity and transition structure in non-stationary input , 2012, NeuroImage.

[24]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[25]  R. Aslin,et al.  Statistical learning in a serial reaction time task: access to separable statistical cues by individual learners. , 2001, Journal of experimental psychology. General.

[26]  D. Berlyne Uncertainty and conflict: a point of contact between information-theory and behavior-theory concepts. , 1957, Psychological review.

[27]  Karl J. Friston,et al.  Behavioral / Systems / Cognitive Striatal Prediction Error Modulates Cortical Coupling , 2010 .

[28]  G Lohmann,et al.  LIPSIA--a new software system for the evaluation of functional magnetic resonance images of the human brain. , 2001, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[29]  Gereon R. Fink,et al.  Cue validity modulates the neural correlates of covert endogenous orienting of attention in parietal and frontal cortex , 2006, NeuroImage.

[30]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[31]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[32]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[33]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[34]  Sibylle C. Herholz,et al.  Statistical learning effects in musicians and non-musicians: An MEG study , 2012, Neuropsychologia.

[35]  Ricarda I. Schubotz,et al.  Surprised at All the Entropy: Hippocampal, Caudate and Midbrain Contributions to Learning from Prediction Errors , 2012, PloS one.

[36]  Jeffrey M. Zacks,et al.  Prediction Error Associated with the Perceptual Segmentation of Naturalistic Events , 2011, Journal of Cognitive Neuroscience.

[37]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[38]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[39]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[40]  Uri Hasson,et al.  Uncertainty in visual and auditory series is coded by modality‐general and modality‐specific neural systems , 2014, Human brain mapping.

[41]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[42]  D Yves von Cramon,et al.  Exploring the detection of associatively novel events using fMRI , 2011, Human brain mapping.

[43]  Franziska M. Korb,et al.  The fraction of an action is more than a movement: Neural signatures of event segmentation in fMRI , 2012, NeuroImage.

[44]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[45]  Michael J. Martinez,et al.  Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain template , 2007, Human brain mapping.

[46]  D. Yves von Cramon,et al.  Variants of uncertainty in decision-making and their neural correlates , 2005, Brain Research Bulletin.

[47]  D. Berlyne Uncertainty and conflict: a point of contact between information-theory and behavior-theory concepts. , 1957, Psychology Review.

[48]  A. Tversky,et al.  Variants of uncertainty , 1982, Cognition.

[49]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[50]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[51]  J. Saffran The Use of Predictive Dependencies in Language Learning , 2001 .

[52]  Ricarda I. Schubotz,et al.  Squeezing lemons in the bathroom: Contextual information modulates action recognition , 2012, NeuroImage.

[53]  Dare A. Baldwin,et al.  Segmenting dynamic human action via statistical structure , 2008, Cognition.

[54]  D Yves von Cramon,et al.  Sequences of Abstract Nonbiological Stimuli Share Ventral Premotor Cortex with Action Observation and Imagery , 2004, The Journal of Neuroscience.

[55]  G. Fink,et al.  REVIEW: The functional organization of the intraparietal sulcus in humans and monkeys , 2005, Journal of anatomy.

[56]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[57]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[58]  Scott T. Grafton,et al.  Beyond grasping: Representation of action in human anterior intraparietal sulcus , 2007, NeuroImage.

[59]  Myron Tribus,et al.  Thermostatics and thermodynamics : an introduction to energy, information and states of matter, with engineering applications , 1961 .

[60]  A. Todorović,et al.  Repetition Suppression and Expectation Suppression Are Dissociable in Time in Early Auditory Evoked Fields , 2012, The Journal of Neuroscience.

[61]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[62]  Jeffrey M. Zacks,et al.  Sequences learned without awareness can orient attention during the perception of human activity , 2008, Psychonomic bulletin & review.

[63]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[64]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.