Experience in judging intent to harm modulates parahippocampal activity: An fMRI study with experienced CCTV operators

Does visual experience in judging intent to harm change our brain responses? And if it does, what are the mechanisms affected? We addressed these questions by studying the abilities of Closed Circuit Television (CCTV) operators, who must identify the presence of hostile intentions using only visual cues in complex scenes. We used functional magnetic resonance imaging to assess which brain processes are modulated by CCTV experience. To this end we scanned 15 CCTV operators and 15 age and gender matched novices while they watched CCTV videos of 16 sec, and asked them to report whether each clip would end in violence or not. We carried out four separate whole-brain analyses including 3 model-based analyses and one analysis of intersubject correlation to examine differences between the two groups. The three model analyses were based on 1) experimentally pre-defined clip activity labels of fight, confrontation, playful, and neutral behaviour, 2) participants' reports of violent outcomes during the scan, and 3) visual saliency within each clip, as pre-assessed using eye-tracking. The analyses identified greater activation in the right superior frontal gyrus for operators than novices when viewing playful behaviour, and reduced activity for operators in comparison with novices in the occipital and temporal regions, irrespective of the type of clips viewed. However, in the parahippocampal gyrus, all three model-based analyses consistently showed reduced activity for experienced CCTV operators. Activity in the anterior part of the parahippocampal gyrus (uncus) was found to increase with years of CCTV experience. The intersubject correlation analysis revealed a further effect of experience, with CCTV operators showing correlated activity in fewer brain regions (superior and middle temporal gyrus, inferior parietal lobule and the ventral striatum) than novices. Our results indicate that long visual experience in action observation, aimed to predict harmful behaviour, modulates brain mechanisms of intent recognition.

[1]  K. Mathiak,et al.  Toward brain correlates of natural behavior: fMRI during violent video games , 2006, Human brain mapping.

[2]  T. Troscianko,et al.  What Happens Next? The Predictability of Natural Behaviour Viewed through CCTV Cameras , 2004, Perception.

[3]  Tatia M.C. Lee,et al.  Neural correlates of regulation of positive and negative emotions: An fMRI study , 2009, Neuroscience Letters.

[4]  Jason P. Mitchell Mentalizing and Marr: An information processing approach to the study of social cognition , 2006, Brain Research.

[5]  M. Hasselmo,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.11 Mechanisms underlying working memory for novel information , 2022 .

[6]  T. Paus,et al.  Modulation of cortical excitability during action observation: a transcranial magnetic stimulation study , 2000, Neuroreport.

[7]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[8]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[9]  T. Schormann,et al.  Functional delineation of the human occipito-temporal areas related to face and scene processing. A PET study. , 2000, Brain : a journal of neurology.

[10]  Anne Springer,et al.  Predicting and memorizing observed action: Differential premotor cortex involvement , 2011, Human brain mapping.

[11]  Scott T. Grafton,et al.  Localization of grasp representations in humans by positron emission tomography , 1996, Experimental Brain Research.

[12]  Davide Rocchesso,et al.  Action expertise reduces brain activity for audiovisual matching actions: An fMRI study with expert drummers , 2011, NeuroImage.

[13]  Jean Decety,et al.  Expertise Modulates the Perception of Pain in Others , 2007, Current Biology.

[14]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[15]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[16]  A. Baddeley,et al.  The Spot-the-Word test: a robust estimate of verbal intelligence based on lexical decision. , 1993, The British journal of clinical psychology.

[17]  G. Weniger,et al.  Impaired associative memory in temporal lobe epilepsy subjects after lesions of hippocampus, parahippocampal gyrus, and amygdala , 2004, Hippocampus.

[18]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[19]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[20]  L. Craighero,et al.  Human motor cortex excitability during the perception of others’ action , 2005, Current Opinion in Neurobiology.

[21]  Paola Cesari,et al.  Fooling the kickers but not the goalkeepers: behavioral and neurophysiological correlates of fake action detection in soccer. , 2013, Cerebral cortex.

[22]  J. Decety,et al.  Effect of subjective perspective taking during simulation of action: a PET investigation of agency , 2001, Nature Neuroscience.

[23]  Swann Pichon,et al.  Perceiving fear in dynamic body expressions , 2007, NeuroImage.

[24]  J. Decety,et al.  Violence as a source of pleasure or displeasure is associated with specific functional connectivity with the nucleus accumbens , 2013, Front. Hum. Neurosci..

[25]  J. Gross,et al.  The Neural Bases of Emotion Regulation: Reappraisal and Suppression of Negative Emotion , 2008, Biological Psychiatry.

[26]  C. Stern,et al.  Prefrontal–Temporal Circuitry for Episodic Encoding and Subsequent Memory , 2000, The Journal of Neuroscience.

[27]  Swann Pichon,et al.  Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions , 2009, NeuroImage.

[28]  Thomas E. Nichols,et al.  Optimization of experimental design in fMRI: a general framework using a genetic algorithm , 2003, NeuroImage.

[29]  A. Kelly,et al.  Human functional neuroimaging of brain changes associated with practice. , 2005, Cerebral cortex.

[30]  Ardhendu Behera,et al.  Searching for threat: factors determining performance during CCTV monitoring , 2009 .

[31]  A. Meltzoff,et al.  A PET Exploration of the Neural Mechanisms Involved in Reciprocal Imitation , 2002, NeuroImage.

[32]  Emily S. Cross,et al.  Dissociable substrates for body motion and physical experience in the human action observation network , 2009, The European journal of neuroscience.

[33]  Miao‐kun Sun,et al.  Trends in cognitive sciences , 2012 .

[34]  K. Kiehl,et al.  Double dissociation between perspective-taking and empathic-concern as predictors of hemodynamic response to another's mistakes. , 2009, Social cognitive and affective neuroscience.

[35]  R. Hari,et al.  Temporal dynamics of cortical representation for action. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[37]  Rebecca Saxe,et al.  Why and how to study Theory of Mind with fMRI , 2006, Brain Research.

[38]  T. Paus,et al.  Brain networks involved in viewing angry hands or faces. , 2006, Cerebral cortex.

[39]  Kenneth C. Scott-Brown,et al.  Looking for trouble: a description of oculomotor search strategies during live CCTV operation , 2013, Front. Hum. Neurosci..

[40]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[41]  Brandon C. Welsh,et al.  Crime prevention effects of closed circuit television: a systematic review , 2002 .

[42]  Heather L. Urry,et al.  Amygdala and Ventromedial Prefrontal Cortex Are Inversely Coupled during Regulation of Negative Affect and Predict the Diurnal Pattern of Cortisol Secretion among Older Adults , 2006, The Journal of Neuroscience.

[43]  Mikko Sams,et al.  Naturalistic fMRI Mapping Reveals Superior Temporal Sulcus as the Hub for the Distributed Brain Network for Social Perception , 2012, Front. Hum. Neurosci..

[44]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[45]  Naomi B. Pitskel,et al.  Neural signatures of autism , 2010, Proceedings of the National Academy of Sciences.

[46]  Aaron L. Berkowitz,et al.  Expertise-related deactivation of the right temporoparietal junction during musical improvisation , 2010, NeuroImage.

[47]  J. Grafman,et al.  Fronto-parietal regulation of media violence exposure in adolescents: a multi-method study. , 2011, Social cognitive and affective neuroscience.

[48]  C. Keysers,et al.  Towards a unifying neural theory of social cognition. , 2006, Progress in brain research.

[49]  J. Gray,et al.  Meditation experience is associated with differences in default mode network activity and connectivity , 2011, Proceedings of the National Academy of Sciences.

[50]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[51]  C. Frith,et al.  Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes. , 2002, Brain : a journal of neurology.

[52]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[53]  Jennifer H. Pfeifer,et al.  Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders , 2006, Nature Neuroscience.

[54]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[55]  Nobuyuki Hiruma,et al.  Determining comprehension and quality of TV programs using eye-gaze tracking , 2008, Pattern Recognit..

[56]  Sarah Sharples,et al.  TRACKING A SUSPICIOUS PERSON USING CCTV: BUT WHAT DO WE MEAN BY SUSPICIOUS BEHAVIOUR? , 2008 .

[57]  Frank Van Overwalle,et al.  Understanding others' actions and goals by mirror and mentalizing systems: A meta-analysis , 2009, NeuroImage.

[58]  G. Humphreys,et al.  Dissociating the neural mechanisms of memory-based guidance of visual selection , 2007, Proceedings of the National Academy of Sciences.

[59]  J. Decety,et al.  Neural mechanisms subserving the perception of human actions , 1999, Trends in Cognitive Sciences.

[60]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[61]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[62]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[63]  A. Buss,et al.  The aggression questionnaire. , 1992, Journal of personality and social psychology.

[64]  Jean Decety,et al.  Leader or follower? Involvement of the inferior parietal lobule in agency , 2002, Neuroreport.

[65]  P. Skudlarski,et al.  The role of the fusiform face area in social cognition: implications for the pathobiology of autism. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[66]  Scott T. Grafton Embodied Cognition and the Simulation of Action to Understand Others , 2009, Annals of the New York Academy of Sciences.

[67]  Ardhendu Behera,et al.  Task relevance predicts gaze in videos of real moving scenes , 2011, Experimental Brain Research.

[68]  T. Allison,et al.  Brain activation evoked by perception of gaze shifts: the influence of context , 2003, Neuropsychologia.

[69]  J C Mazziotta,et al.  Reafferent copies of imitated actions in the right superior temporal cortex , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[70]  D. Amaral,et al.  Lesions of perirhinal and parahippocampal cortex that spare the amygdala and hippocampal formation produce severe memory impairment , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[71]  Andrew N. Meltzoff,et al.  Neural circuits involved in imitation and perspective-taking , 2006, NeuroImage.

[72]  R. Zatorre,et al.  Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[73]  R. Passingham,et al.  Brain Mechanisms for Inferring Deceit in the Actions of Others , 2004, The Journal of Neuroscience.

[74]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[75]  G. Muehllehner,et al.  Positron emission tomography , 2006, Physics in medicine and biology.

[76]  M. Chun,et al.  Linking Implicit and Explicit Memory: Common Encoding Factors and Shared Representations , 2006, Neuron.

[77]  E. Procyk,et al.  Brain activity during observation of actions. Influence of action content and subject's strategy. , 1997, Brain : a journal of neurology.

[78]  R. Dolan,et al.  Psychology: Reward value of attractiveness and gaze , 2001, Nature.

[79]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[80]  Arne D. Ekstrom,et al.  Single-Neuron Responses in Humans during Execution and Observation of Actions , 2010, Current Biology.

[81]  S. Dehaene,et al.  A direct intracranial record of emotions evoked by subliminal words. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[82]  S. Weinberger Airport security: Intent to deceive? , 2010, Nature.

[83]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[84]  A. Goel,et al.  Analysis of the anatomy of the Papez circuit and adjoining limbic system by fiber dissection techniques , 2012, Journal of Clinical Neuroscience.

[85]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[86]  G. V. Hoesen,et al.  The parahippocampal gyrus: New observations regarding its cortical connections in the monkey , 1982, Trends in Neurosciences.

[87]  E. Bullmore,et al.  The role of MT+/V5 during biological motion perception in Asperger Syndrome: An fMRI study , 2007 .

[88]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[89]  Scott T. Grafton,et al.  Functional anatomy of pointing and grasping in humans. , 1996, Cerebral cortex.

[90]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[91]  Ricarda I Schubotz,et al.  Neural changes when actions change: Adaptation of strong and weak expectations , 2013, Human brain mapping.

[92]  T. Smith,et al.  Attentional synchrony and the influence of viewing task on gaze behavior in static and dynamic scenes. , 2013, Journal of vision.

[93]  R. Dolan,et al.  Unconscious fear influences emotional awareness of faces and voices. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[94]  J. R. Baker,et al.  The hippocampal formation participates in novel picture encoding: evidence from functional magnetic resonance imaging. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[95]  Jean M. Vettel,et al.  Visual motion and the neural correlates of event perception , 2006, Brain Research.

[96]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[97]  Kevin N. Ochsner,et al.  For better or for worse: neural systems supporting the cognitive down- and up-regulation of negative emotion , 2004, NeuroImage.

[98]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[99]  Jessica F. Cantlon,et al.  Neural Activity during Natural Viewing of Sesame Street Statistically Predicts Test Scores in Early Childhood , 2013, PLoS biology.

[100]  Iain D Gilchrist,et al.  Visual Search in the Real World: Evidence for the Formation of Distractor Representations , 2011, Perception.

[101]  G. Rizzolatti,et al.  Motor facilitation during action observation: a magnetic stimulation study. , 1995, Journal of neurophysiology.

[102]  J. Bancaud [Clinical symptomatology of epileptic seizures of temporal origin]. , 1987, Revue neurologique.

[103]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.