Using minimal human-computer interfaces for studying the interactive development of social awareness

According to the enactive approach to cognitive science, perception is essentially a skillful engagement with the world. Learning how to engage via a human-computer interface (HCI) can therefore be taken as an instance of developing a new mode of experiencing. Similarly, social perception is theorized to be primarily constituted by skillful engagement between people, which implies that it is possible to investigate the origins and development of social awareness using multi-user HCIs. We analyzed the trial-by-trial objective and subjective changes in sociality that took place during a perceptual crossing experiment in which embodied interaction between pairs of adults was mediated over a minimalist haptic HCI. Since that study required participants to implicitly relearn how to mutually engage so as to perceive each other's presence, we hypothesized that there would be indications that the initial developmental stages of social awareness were recapitulated. Preliminary results reveal that, despite the lack of explicit feedback about task performance, there was a trend for the clarity of social awareness to increase over time. We discuss the methodological challenges involved in evaluating whether this trend was characterized by distinct developmental stages of objective behavior and subjective experience.

[1]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[2]  Maria Adler,et al.  Enaction Toward A New Paradigm For Cognitive Science , 2016 .

[3]  A. Roepstorff,et al.  Why Trust the Subject , 2003 .

[4]  Gregory J. Mills.  Dialogue in joint activity: complementarity, convergence and conventionalization , 2014 .

[5]  Antoine Lutz,et al.  Toward a neurophenomenology as an account of generative passages: a first empirical case study , 2002 .

[6]  Tom Froese,et al.  Using Human–Computer Interfaces to Investigate ‘Mind-As-It-Could-Be’ from the First-Person Perspective , 2012, Cognitive Computation.

[7]  Tom Froese,et al.  Embodied social interaction constitutes social cognition in pairs of humans: A minimalist virtual reality experiment , 2014, Scientific Reports.

[8]  E. Cuffari.  On Being Mindful about Misunderstandings in Languaging: Making Sense of Non-Sense as the Way to Sharing Linguistic Meaning , 2014 .

[9]  Creso Franco,et al.  Genetic epistemology, history of science and science education , 1992 .

[10]  James R. Brockmole,et al.  Compressing perceived distance with remote tool-use: real, imagined, and remembered. , 2012, Journal of experimental psychology. Human perception and performance.

[11]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[12]  D. Stern.  The interpersonal world of infant , 1985 .

[13]  Darren Langdridge,et al.  The Child's Relations with Others , 2005 .

[14]  Michele Merritt.  Making (Non)sense of Gender , 2014 .

[15]  Simon Garrod,et al.  Experimental Semiotics: A Review , 2010, Front. Hum. Neurosci..

[16]  Marieke Rohde,et al.  Perceptual crossing: the simplest online paradigm , 2012, Front. Hum. Neurosci..

[17]  Olivier Oullier,et al.  Social Coordination, from the Perspective of Coordination Dynamics , 2009, Encyclopedia of Complexity and Systems Science.

[18]  Claire Petitmengin,et al.  Describing one’s subjective experience in the second person: An interview method for the science of consciousness , 2006 .

[19]  Didier Bottineau,et al.  Language and enaction , 2008 .

[20]  Sabine C. Koch,et al.  Embodied affectivity: on moving and being moved , 2014, Front. Psychol..

[21]  Kevin Shockley,et al.  Interpersonal Synergies , 2010, Front. Psychology.

[22]  John Michael,et al.  Interaction and social cognition: A comment on Auvray et al.’s perceptual crossing paradigm , 2012 .

[23]  S. Gallagher.  Inference or interaction: social cognition without precursors , 2008 .

[24]  Marek McGann,et al.  Self–other contingencies: Enacting social perception , 2009 .

[25]  H. D. Jaegher,et al.  Social understanding through direct perception? Yes, by interacting , 2009, Consciousness and Cognition.

[26]  M. Overgaard,et al.  Introspection and subliminal perception , 2004 .

[27]  Sylvia Weir,et al.  Action perception , 1974 .

[28]  Malika Auvray,et al.  Perception With Compensatory Devices: From Sensory Substitution to Sensorimotor Extension , 2009, Cogn. Sci..

[29]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[30]  D. Stern.  The Interpersonal World of the Infant: A View from Psychoanalysis and Developmental Psychology , 2019 .

[31]  Tom Froese,et al.  The Extended Body: a Case Study in the Neurophenomenology of Social Interaction , 2012 .

[32]  E. Tronick.  Why is connection with others so critical? The formation of dyadic states of consciousness and the expansion of individuals' states of consciousness: coherence governed selection and the co-creation of meaning out of messy meaning making. , 2005 .

[33]  Véronique Havelange,et al.  The Ontological Constitution of Cognition and the Epistemological Constitution of Cognitive Science: Phenomenology, Enaction, and Technology , 2010 .

[34]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[35]  H. Dreyfus,et al.  Being-in-the-World: A Commentary on Heidegger's Being and Time. , 1990 .

[36]  T. Froese,et al.  Is it normal to be a principal mindreader? Revising theories of social cognition on the basis of schizophrenia and high functioning autism-spectrum disorders. , 2013, Research in developmental disabilities.

[37]  R. T. Hurlburt.  Investigating Pristine Inner Experience: Moments of Truth , 2011 .

[38]  E. D. Paolo,et al.  The enactive approach: Theoretical sketches from cell to society , 2011 .

[39]  D. Cohen,et al.  Culture and the Structure of Personal Experience: Insider and Outsider Phenomenologies of the Self and Social World , 2007 .

[40]  Hideyuki Ando,et al.  Experimental study on co-evolution of categorical perception and communication systems in humans , 2012, Psychological Research.

[41]  C. Lenay,et al.  SENSORY SUBSTITUTION: LIMITS AND PERSPECTIVES , 2003 .

[42]  C. Trevarthen.  Communication and cooperation in early infancy: a description of primary intersubjectivity , 1979 .

[43]  Dennis L. Sepper.  Being-in-the-World: A Commentary on Heidegger’s Being and Time, Division I , 1991 .

[44]  A. Fogel.  Developing through relationships origins of communication, self, and culture , 1993 .

[45]  Thomas Fuchs,et al.  The phenomenology and development of social perspectives , 2013 .

[46]  Shaun Gallagher,et al.  Understanding others through primary interaction and narrative practice , 2008 .

[47]  Daniel M. Wegner,et al.  The Forms of Social Awareness , 1982 .

[48]  J. Stewart.  Foundational Issues in Enaction as a Paradigm for Cognitive Science: From the Origin of Life to Consciousness and Writing , 2010 .

[49]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[50]  M. Bender.  Perceptual interactions. , 1970, Modern trends in neurology.

[51]  G. Ritchie,et al.  Signalling signalhood and the emergence of communication , 2008, Cognition.

[52]  S. Brownlow,et al.  Perception of movement and dancer characteristics from point-light displays of dance , 1997 .

[53]  Evan Thompson,et al.  Empathy and consciousness. , 2001 .

[54]  S. Gallagher.  Direct perception in the intersubjective context , 2008, Consciousness and Cognition.

[55]  S. Gallagher,et al.  Getting interaction theory (IT) together: integrating developmental, phenomenological, enactive, and dynamical approaches to social interaction , 2012 .

[56]  Jane M Lymer.  MERLEAU-PONTY AND THE AFFECTIVE MATERNAL- FOETAL RELATION , 2011 .

[57]  Hanne De Jaegher.  Social understanding through direct perception? Yes, by interacting. , 2009, Consciousness and cognition.

[58]  Riccardo Fusaroli,et al.  Dialog as interpersonal synergy , 2014, New Ideas in Psychology.

[59]  M. Ratcliffe.  Rethinking Commonsense Psychology: A Critique of Folk Psychology, Theory of Mind and Simulation , 2008 .

[60]  R. Beer.  Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[61]  Tom Froese,et al.  Re-Viewing from Within: A Commentary on First- and Second-Person Methods in the Science of Consciousness , 2011 .

[62]  Harald Atmanspacher,et al.  Acategorial states in a reprsentational theory of mental processes , 2010 .

[63]  M. Rohde,et al.  Sensitivity to social contingency or stability of interaction? Modelling the dynamics of perceptual crossing , 2008 .

[64]  P. H. Miller,et al.  Developmental change: Lessons from microgenesis. , 1999 .

[65]  Charles Lenay,et al.  “ It ’ s So Touching ” : Emotional Value in Distal Contact , 2022 .

[66]  M. Sheets‐Johnstone.  The Primacy of Movement , 1999 .

[67]  Charles Lenay,et al.  Beyond the internalism/externalism debate: The constitution of the space of perception , 2010, Consciousness and Cognition.

[68]  Shaun Gallagher,et al.  The socially extended mind , 2013, Cognitive Systems Research.

[69]  J. Nadel,et al.  Expectancies for social contingency in 2‐month‐olds , 1999 .

[70]  V. Reddy.  Before the ‘Third Element’: Understanding Attention to Self , 2005 .

[71]  Vasudevi Reddy,et al.  Participants Don’t Need Theories , 2004 .

[72]  K. Crowley,et al.  The microgenetic method. A direct means for studying cognitive development. , 1991, The American psychologist.

[73]  Vasudevi Reddy,et al.  On being the object of attention: implications for self–other consciousness , 2003, Trends in Cognitive Sciences.

[74]  Marek McGann,et al.  Perceptual Modalities: Modes of Presentation or Modes of Interaction? , 2010 .

[75]  M. Auvray,et al.  Perceptual interactions in a minimalist virtual environment , 2009 .

[76]  R. Stout.  What someone’s behaviour must be like if we are to be aware of their emotions in it , 2012 .

[77]  Joel Krueger,et al.  Seeing mind in action , 2012 .

[78]  Colwyn Trevarthen,et al.  Consciousness in infants , 2007 .

[79]  E. D. Paolo,et al.  Participatory sensemaking An enactive approach to social cognition , 2007 .

[80]  V. Rosenthal,et al.  Microgenesis, immediate experience and visual processes in reading. , 2004 .

[81]  F. Varela,et al.  Guiding the study of brain dynamics by using first-person data: Synchrony patterns correlate with ongoing conscious states during a simple visual task , 2002, Proceedings of the National Academy of Sciences of the United States of America.