Music Performance As an Experimental Approach to Hyperscanning Studies

Humans are fundamentally social and tend to create emergent organizations when interacting with each other; from dyads to families, small groups, large groups, societies, and civilizations. The study of the neuronal substrate of human social behavior is currently gaining momentum in the young field of social neuroscience. Hyperscanning is a neuroimaging technique by which we can study two or more brains simultaneously while participants interact with each other. The aim of this article is to discuss several factors that we deem important in designing hyperscanning experiments. We first review hyperscanning studies performed by means of electroencephalography (EEG) that have been relying on a continuous interaction paradigm. Then, we provide arguments for favoring ecological paradigms, for studying the emotional component of social interactions and for performing longitudinal studies, the last two aspects being largely neglected so far in the hyperscanning literature despite their paramount importance in social sciences. Based on these premises, we argue that music performance is a suitable experimental setting for hyperscanning and that for such studies EEG is an appropriate choice as neuroimaging modality.

[1]  U. Lindenberger,et al.  Cardiac and Respiratory Patterns Synchronize between Persons during Choir Singing , 2011, PloS one.

[2]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  F. Scholkmann,et al.  Between-brain coherence during joint n-back task performance: A two-person functional near-infrared spectroscopy study , 2012, Behavioural Brain Research.

[4]  J. S. Jordan,et al.  Forward-Looking Aspects of Perception–Action Coupling as a Basis for Embodied Communication , 2009 .

[5]  Y. Yamaguchi,et al.  Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction , 2013, Scientific Reports.

[6]  F. Cincotti,et al.  Imaging the social brain: multi-subjects EEG recordings during the “Chicken's game” , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[7]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[8]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[9]  Edward W. Large,et al.  Perceiving temporal regularity in music , 2002, Cogn. Sci..

[10]  Kevin Shockley,et al.  Interpersonal Synergies , 2010, Front. Psychology.

[11]  G. Glover,et al.  Dissociable Intrinsic Connectivity Networks for Salience Processing and Executive Control , 2007, The Journal of Neuroscience.

[12]  Istvan Molnar-Szakacs,et al.  Being Together in Time: Musical Experience and the Mirror Neuron System , 2009 .

[13]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[14]  Robert J. Zatorre,et al.  Mental Concerts: Musical Imagery and Auditory Cortex , 2005, Neuron.

[15]  The Musician's Brain as a Model for Adaptive and Maladaptive Plasticity , 2010 .

[16]  Gary H. Glover,et al.  A quantitative comparison of NIRS and fMRI across multiple cognitive tasks , 2011, NeuroImage.

[17]  R. Hari,et al.  Brain basis of human social interaction: from concepts to brain imaging. , 2009, Physiological reviews.

[18]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[19]  Rebecca Saxe,et al.  Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience , 2010, NeuroImage.

[20]  D. Knippenberg Embodying who we are: leader group prototypicality and leadership effectiveness , 2011 .

[21]  F. Babiloni,et al.  Methods for the EEG hyperscanning. Simultaneous recordings from multiple subjects during social interaction , 2011, 2011 8th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the 2011 8th International Conference on Bioelectromagnetism.

[22]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[23]  Shu-Chen Li,et al.  Brains swinging in concert: cortical phase synchronization while playing guitar , 2009, BMC Neuroscience.

[24]  H. Petsche,et al.  Long-Range Synchrony in the γ Band: Role in Music Perception , 2001, The Journal of Neuroscience.

[25]  Claus Lamm,et al.  Meta-analytic evidence for common and distinct neural networks associated with directly experienced pain and empathy for pain , 2011, NeuroImage.

[26]  C. Büchel,et al.  Amygdala Activation Predicts Gaze toward Fearful Eyes , 2009, The Journal of Neuroscience.

[27]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[28]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[29]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[30]  Chaozhe Zhu,et al.  Neural Synchronization during Face-to-Face Communication , 2012, The Journal of Neuroscience.

[31]  Viktor Müller,et al.  Intra- and interbrain synchronization and network properties when playing guitar in duets , 2012, Front. Hum. Neurosci..

[32]  D. Randel The Harvard dictionary of music , 2003 .

[33]  Jason M Haberman,et al.  Sensorimotor coupling in music and the psychology of the groove. , 2012, Journal of experimental psychology. General.

[34]  N. Sadato,et al.  Hyperscanning neuroimaging technique to reveal the “two-in-one” system in social interactions , 2015, Neuroscience Research.

[35]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[36]  Viktor Müller,et al.  Directionality in hyperbrain networks discriminates between leaders and followers in guitar duets , 2013, Front. Hum. Neurosci..

[37]  I. Peretz,et al.  Patterns of music agnosia associated with middle cerebral artery infarcts. , 2000, Brain : a journal of neurology.

[38]  Ivan Toni,et al.  Endogenous Testosterone Modulates Prefrontal–Amygdala Connectivity during Social Emotional Behavior , 2011, Cerebral cortex.

[39]  Laura Astolfi,et al.  Hypermethods for EEG hyperscanning , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Lea Fleischer,et al.  The Senses Considered As Perceptual Systems , 2016 .

[41]  S. Preston,et al.  Empathy: Its ultimate and proximate bases. , 2001, The Behavioral and brain sciences.

[42]  Silke Dodel,et al.  Brain Signatures of Team Performance , 2011, HCI.

[43]  A. Schnider,et al.  Receptive amusia: temporal auditory processing deficit in a professional musician following a left temporo-parietal lesion , 2004, Neuropsychologia.

[44]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[45]  Joseph P. Forgas,et al.  Affective influences on attitudes and judgments. , 2003 .

[46]  S. Shimojo,et al.  Interpersonal body and neural synchronization as a marker of implicit social interaction , 2012, Scientific Reports.

[47]  A. Friederici,et al.  Brain Indices of Music Processing: Nonmusicians are Musical , 2000, Journal of Cognitive Neuroscience.

[48]  K. Ochsner,et al.  The neuroscience of empathy: progress, pitfalls and promise , 2012, Nature Neuroscience.

[49]  Laura Astolfi,et al.  Study of the functional hyperconnectivity between couples of pilots during flight simulation: An EEG hyperscanning study , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Guillaume Dumas,et al.  Your body, my body, our coupling moves our bodies , 2014, Front. Hum. Neurosci..

[51]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[52]  Jakob Heinzle,et al.  Flow of affective information between communicating brains , 2011, NeuroImage.

[53]  U. Neisser Cognitive Psychology. (Book Reviews: Cognition and Reality. Principles and Implications of Cognitive Psychology) , 1976 .

[54]  Steven M. Platek,et al.  Working Together May Be Better: Activation of Reward Centers during a Cooperative Maze Task , 2012, PloS one.

[55]  Yun Kyongsik,et al.  Emotional Interactions in Human Decision-Making using EEG Hyperscanning , 2008 .

[56]  M. Phillips,et al.  Right Frontoinsular Cortex and Subcortical Activity to Infant Cry Is Associated with Maternal Mental State Talk , 2015, The Journal of Neuroscience.

[57]  Claudio Del Percio,et al.  Brains “in concert”: Frontal oscillatory alpha rhythms and empathy in professional musicians , 2012, NeuroImage.

[58]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[59]  T. Singer,et al.  The empathic brain: how, when and why? , 2006, Trends in Cognitive Sciences.

[60]  R. Zatorre,et al.  Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[61]  P. Read Montague,et al.  King-Casas Economic Exchange Getting to Know You : Reputation and Trust in a Two-Person , 2014 .

[62]  Peter E. Keller,et al.  What can music tell us about social interaction? , 2015, Trends in Cognitive Sciences.

[63]  E. Brunswik Organismic achievement and environmental probability. , 1943 .

[64]  Martin Wolf,et al.  Between-brain connectivity during imitation measured by fNIRS , 2012, NeuroImage.

[65]  R. Hari,et al.  Emotions promote social interaction by synchronizing brain activity across individuals , 2012, Proceedings of the National Academy of Sciences.

[66]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[67]  P. Salovey,et al.  Emotional Intelligence and Social Interaction , 2004, Personality & social psychology bulletin.

[68]  F. Cincotti,et al.  Cortical Activity and Connectivity of Human Brain during the Prisoner's Dilemma: an EEG Hyperscanning Study , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[69]  Mark H Johnson,et al.  Predictive motor activation during action observation in human infants , 2009, Biology Letters.

[70]  Mukesh Dhamala,et al.  Hyperscanning : Simultaneous fMRI during Linked Social Interactions , 2001 .

[71]  A. Damasio,et al.  The return of Phineas Gage: clues about the brain from the skull of a famous patient. , 1994, Science.

[72]  William Russo,et al.  Jazz composition and orchestration , 1968 .

[73]  Marco Congedo,et al.  Subspace Projection Filters for Real-Time Brain Electromagnetic Imaging , 2006, IEEE Transactions on Biomedical Engineering.

[74]  C. Nelson,et al.  Tuning the developing brain to social signals of emotions , 2009, Nature Reviews Neuroscience.

[75]  Lauri Parkkonen,et al.  The brain timewise: how timing shapes and supports brain function , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[76]  J. Swain Harmonic Rhythm: Analysis and Interpretation , 2002 .

[77]  E. D. Paolo,et al.  The interactive brain hypothesis , 2012, Front. Hum. Neurosci..

[78]  K. Berridge Reward learning: Reinforcement, incentives, and expectations , 2000 .

[79]  P. Janata,et al.  Being and feeling in sync with an adaptive virtual partner: brain mechanisms underlying dynamic cooperativity. , 2013, Cerebral cortex.

[80]  U. Bronfenbrenner Toward an Experimental Ecology of Human Development. , 1977 .

[81]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[82]  Mark H. Johnson,et al.  The eye contact effect: mechanisms and development , 2009, Trends in Cognitive Sciences.

[83]  A. Meltzoff,et al.  A PET Exploration of the Neural Mechanisms Involved in Reciprocal Imitation , 2002, NeuroImage.

[84]  C. Frith,et al.  Mechanisms of social cognition. , 2012, Annual review of psychology.

[85]  W. Jay Dowling,et al.  The Development of Music Perception and Cognition , 1999 .

[86]  Colin F Camerer,et al.  Agent-Specific Responses in the Cingulate Cortex During Economic Exchanges , 2006, Science.

[87]  K. Lewin,et al.  Defining the 'field at a given time' , 2011 .

[88]  Alfonso Caramazza,et al.  Asymmetric fMRI adaptation reveals no evidence for mirror neurons in humans , 2009, Proceedings of the National Academy of Sciences.

[89]  Larry J Young,et al.  Microsatellite Instability Generates Diversity in Brain and Sociobehavioral Traits , 2005, Science.

[90]  K. Kubota,et al.  Synchronous activity of two people's prefrontal cortices during a cooperative task measured by simultaneous near-infrared spectroscopy. , 2011, Journal of biomedical optics.

[91]  B. Repp Effects of Auditory Feedback Deprivation on Expressive Piano Performance , 1999 .

[92]  Peter M. Vishton,et al.  Haptically Linked Dyads , 2006, Psychological science.

[93]  M. Schmuckler What Is Ecological Validity? A Dimensional Analysis. , 2001, Infancy : the official journal of the International Society on Infant Studies.

[94]  Lars Kai Hansen,et al.  Frontal alpha oscillations distinguish leaders from followers: Multivariate decoding of mutually interacting brains , 2014, NeuroImage.

[95]  Viktor Müller,et al.  Intra- and Inter-Brain Synchronization during Musical Improvisation on the Guitar , 2013, PloS one.

[96]  J. Kelso,et al.  From the Cover : The phi complex as a neuromarker of human social coordination , 2007 .

[97]  Alan C. Evans,et al.  Musical Training Shapes Structural Brain Development , 2009, The Journal of Neuroscience.

[98]  P. Harris,et al.  Young Children's Theory of Mind and Emotion , 1989 .

[99]  A. Bachrach,et al.  Audience entrainment during live contemporary dance performance: physiological and cognitive measures , 2015, Front. Hum. Neurosci..

[100]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[101]  Josh H. McDermott,et al.  The evolution of the music faculty: a comparative perspective , 2003, Nature Neuroscience.

[102]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[103]  Laura Astolfi,et al.  Defecting or Not Defecting: How to “Read” Human Behavior during Cooperative Games by EEG Measurements , 2010, PloS one.

[104]  G. Schlaug,et al.  Brain Structures Differ between Musicians and Non-Musicians , 2003, The Journal of Neuroscience.

[105]  S. Mithen,et al.  The Singing Neanderthals: the Origins of Music, Language, Mind and Body, by Steven Mithen. London: Weidenfeld & Nicholson, 2005. ISBN 0-297-64317-7 hardback £20 & US$25.2; ix+374 pp. , 2006, Cambridge Archaeological Journal.

[106]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[107]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[108]  Viktor Müller,et al.  Hyper-Brain Networks Support Romantic Kissing in Humans , 2014, PloS one.

[109]  Xu Cui,et al.  NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation , 2012, NeuroImage.

[110]  D. Perrett,et al.  Being the target of another’s emotion: a PET study , 2003, Neuropsychologia.

[111]  J. Mattingley,et al.  Brain regions with mirror properties: A meta-analysis of 125 human fMRI studies , 2012, Neuroscience & Biobehavioral Reviews.

[112]  M. Cheung,et al.  Music training improves verbal memory , 1998, Nature.

[113]  C. Jutten,et al.  Touch increases autonomic coupling between romantic partners , 2014, Front. Behav. Neurosci..

[114]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[115]  A Thron,et al.  Playing piano in the mind--an fMRI study on music imagery and performance in pianists. , 2004, Brain research. Cognitive brain research.

[116]  Alessandro Livi,et al.  Mirror Neuron Activation Prior to Action Observation in a Predictable Context , 2014, The Journal of Neuroscience.

[117]  Girijesh Prasad,et al.  Electrophysiological signatures of intentional social coordination in the 10–12Hz range , 2012, NeuroImage.

[118]  R. Adolphs Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[119]  L. Jäncke Music, memory and emotion , 2008, Journal of biology.

[120]  M. Iacoboni,et al.  Empathy: Gender effects in brain and behavior , 2014, Neuroscience & Biobehavioral Reviews.

[121]  Susan Hallam,et al.  The power of music: Its impact on the intellectual, social and personal development of children and young people , 2010 .

[122]  Relating the "mirrorness" of mirror neurons to their origins. , 2014, The Behavioral and brain sciences.

[123]  Matthew D. Lieberman,et al.  The emergence of social cognitive neuroscience. , 2001, The American psychologist.

[124]  A. Marsh The neuroscience of empathy , 2018, Current Opinion in Behavioral Sciences.

[125]  S. Koelsch Brain correlates of music-evoked emotions , 2014, Nature Reviews Neuroscience.

[126]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[127]  Guillén Fernández,et al.  Stressed Memories: How Acute Stress Affects Memory Formation in Humans , 2009, The Journal of Neuroscience.

[128]  Y. Hu,et al.  Synchronous brain activity during cooperative exchange depends on gender of partner: A fNIRS‐based hyperscanning study , 2015, Human brain mapping.

[129]  E. Altenmüller,et al.  The musician's brain as a model of neuroplasticity , 2002, Nature Reviews Neuroscience.

[130]  Andrea M. Hunt,et al.  Boundaries and potentials of traditional and alternative neuroscience research methods in music therapy research , 2015, Front. Hum. Neurosci..