A Hybrid Human-Neurorobotics Approach to Primary Intersubjectivity via Active Inference

Interdisciplinary efforts from developmental psychology, phenomenology, and philosophy of mind, have studied the rudiments of social cognition and conceptualized distinct forms of intersubjective communication and interaction at human early life. Interaction theorists consider primary intersubjectivity a non-mentalist, pre-theoretical, non-conceptual sort of processes that ground a certain level of communication and understanding, and provide support to higher-level cognitive skills. We argue the study of human/neurorobot interaction consists in a unique opportunity to deepen understanding of underlying mechanisms in social cognition through synthetic modeling, while allowing to examine a second person experiential (2PP) access to intersubjectivity in embodied dyadic interaction. Concretely, we propose the study of primary intersubjectivity as a 2PP experience characterized by predictive engagement, where perception, cognition, and action are accounted for an hermeneutic circle in dyadic interaction. From our interpretation of the concept of active inference in free-energy principle theory, we propose an open-source methodology named neural robotics library (NRL) for experimental human/neurorobot interaction, wherein a demonstration program named virtual Cartesian robot (VCBot) provides an opportunity to experience the aforementioned embodied interaction to general audiences. Lastly, through a study case, we discuss some ways human-robot primary intersubjectivity can contribute to cognitive science research, such as to the fields of developmental psychology, educational technology, and cognitive rehabilitation.

[1]  R. Hepburn,et al.  BEING AND TIME , 2010 .

[2]  E. Husserl,et al.  Cartesian Meditations: An Introduction to Phenomenology , 1931 .

[3]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[4]  Paulo Freire,et al.  Pedagogy of the Oppressed , 2019, Toward a Just World Order.

[5]  R. Gregory Concepts and mechanisms of perception , 1974 .

[6]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[7]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[8]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[9]  C. Trevarthen Communication and cooperation in early infancy: a description of primary intersubjectivity , 1979 .

[10]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[11]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[12]  Bjarne Stroustrup,et al.  C++ Programming Language , 1986, IEEE Softw..

[13]  J. Habermas,et al.  The Theory of Communicative Action, Vol. 1, Reason and the Rationalization of Society , 1986 .

[14]  A. Leslie Pretense and representation: The origins of "theory of mind." , 1987 .

[15]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[16]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[17]  B. Bower A Child's Theory of Mind , 1993 .

[18]  W. Freeman Societies of Brains: A Study in the Neuroscience of Love and Hate. By W. J. Freeman. Erlbaum: Hillsdale, NJ. 1994. , 1997, Psychological Medicine.

[19]  Martin Davies,et al.  Mental Simulation: Evaluations and Applications - Reading in Mind and Language , 1995 .

[20]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[21]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[22]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[23]  Mitchel Resnick,et al.  To mindstorms and beyond: evolution of a construction kit for magical machines , 2000 .

[24]  Shaun Gallagher,et al.  The practice of mind: Theory, simulation or primary interaction? , 2001 .

[25]  E. Ackermann Piaget ’ s Constructivism , Papert ’ s Constructionism : What ’ s the difference ? , 2001 .

[26]  S. Gallagher The Practice of Mind , 2001 .

[27]  J. Norman Two visual systems and two theories of perception: An attempt to reconcile the constructivist and ecological approaches. , 2001, The Behavioral and brain sciences.

[28]  C. Mateer,et al.  Cognitive Rehabilitation: An Integrative Neuropsychological Approach , 2001 .

[29]  Jun Tani,et al.  Learning to generate articulated behavior through the bottom-up and the top-down interaction processes , 2003, Neural Networks.

[30]  Wisama Khalil,et al.  Modeling, Identification and Control of Robots , 2003 .

[31]  Yasuo Kuniyoshi,et al.  From Humanoid Embodiment to Theory of Mind , 2003, Embodied Artificial Intelligence.

[32]  A. Gopnik,et al.  Mechanisms of theory formation in young children , 2004, Trends in Cognitive Sciences.

[33]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[34]  George Siemens Connectivism: Learning Theory or Pastime of the Self-Amused? , 2006 .

[35]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[36]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[37]  S. Gallagher Understanding others: embodied social cognition , 2008 .

[38]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[39]  P. Rochat,et al.  From Imitation to Reciprocation and Mutual Recognition , 2008 .

[40]  V. Reddy How Infants Know Minds , 2008 .

[41]  Tom Ziemke,et al.  Enactive artificial intelligence: Investigating the systemic organization of life and mind , 2009, Artif. Intell..

[42]  Chrystopher L. Nehaniv,et al.  Effects of Embodiment and Gestures on Social Interaction in Drumming Games with a Humanoid Robot , 2009, Adv. Robotics.

[43]  M. Auvray,et al.  Perceptual interactions in a minimalist virtual environment , 2009 .

[44]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[45]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[46]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[47]  N. Gangopadhyay Alvin I. GoldmanSimulating Minds: The Philosophy, Psychology and Neuroscience of Mindreading , 2011, The British Journal for the Philosophy of Science.

[48]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[49]  Shin Ishii,et al.  Multi-scale, multi-modal neural modeling and simulation , 2011, Neural Networks.

[50]  Shannon Spaulding,et al.  Introduction to debates on embodied social cognition , 2012 .

[51]  Charles Lenay,et al.  Minimalist Approach to Perceptual Interactions , 2012, Front. Hum. Neurosci..

[52]  Fabiane Barreto Vavassori Benitti,et al.  Exploring the educational potential of robotics in schools: A systematic review , 2012, Comput. Educ..

[53]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[54]  Katja Liebal,et al.  The emergent practice of infant compliance: An exploration in two cultures. , 2013, Developmental psychology.

[55]  Raymond J. Dolan,et al.  The anatomy of choice: active inference and agency , 2013, Front. Hum. Neurosci..

[56]  J. Hohwy The Predictive Mind , 2013 .

[57]  Thomas Fuchs,et al.  The phenomenology and development of social perspectives , 2013 .

[58]  A. Pollock,et al.  Cognitive Rehabilitation for Executive Dysfunction in Adults With Stroke or Other Adult Nonprogressive Acquired Brain Damage , 2013, The Cochrane database of systematic reviews.

[59]  Shigeki Sugano,et al.  Learning to Reproduce Fluctuating Time Series by Inferring Their Time-Dependent Stochastic Properties: Application in Robot Learning Via Tutoring , 2013, IEEE Transactions on Autonomous Mental Development.

[60]  R. Saxe,et al.  Theory of Mind: A Neural Prediction Problem , 2013, Neuron.

[61]  J. Hohwy,et al.  Social Cognition as Causal Inference: Implications for Common Knowledge and Autism , 2014 .

[62]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[63]  L. Astolfi,et al.  Social neuroscience and hyperscanning techniques: Past, present and future , 2014, Neuroscience & Biobehavioral Reviews.

[64]  J. Wagemans,et al.  Precise minds in uncertain worlds: predictive coding in autism. , 2014, Psychological review.

[65]  G. Rizzolatti,et al.  The mirror mechanism: recent findings and perspectives , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[66]  Karl J. Friston,et al.  Human Neuroscience Hypothesis and Theory Article an Aberrant Precision Account of Autism , 2022 .

[67]  Tom Froese,et al.  Embodied social interaction constitutes social cognition in pairs of humans: A minimalist virtual reality experiment , 2014, Scientific Reports.

[68]  A. Cangelosi,et al.  Developmental Robotics: From Babies to Robots , 2015 .

[69]  Philippe Martinet,et al.  Cognitive Modeling for Automating Learning in Visually-Guided Manipulative Tasks , 2015 .

[70]  Spyros G. Tzafestas,et al.  Roboethics: A Navigating Overview , 2015 .

[71]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[72]  Karl J. Friston,et al.  Active inference, communication and hermeneutics , 2015, Cortex.

[73]  Karl J. Friston,et al.  A Duet for one , 2015, Consciousness and Cognition.

[74]  Christine Chevallereau,et al.  A Top-Down and Bottom-Up Visual Attention Model for Humanoid Object Approaching and Obstacle Avoidance , 2016, 2016 XIII Latin American Robotics Symposium and IV Brazilian Robotics Symposium (LARS/SBR).

[75]  J. Tani Exploring Robotic Minds: Actions, Symbols, and Consciousness as Self-Organizing Dynamic Phenomena , 2016 .

[76]  N. Lincoln,et al.  Memory rehabilitation for people with multiple sclerosis. , 2016, The Cochrane database of systematic reviews.

[77]  Stavros N. Demetriadis,et al.  Advancing students' computational thinking skills through educational robotics: A study on age and gender relevant differences , 2016, Robotics Auton. Syst..

[78]  Christine Chevallereau,et al.  Grounding humanoid visually guided walking: From action-independent to action-oriented knowledge , 2016, Inf. Sci..

[79]  Maya B. Mathur,et al.  Navigating a social world with robot partners: A quantitative cartography of the Uncanny Valley , 2016, Cognition.

[80]  Shaun Gallagher,et al.  Active inference, enactivism and the hermeneutics of social cognition , 2016, Synthese.

[81]  Michael D. Kirchhoff Autopoiesis, free energy, and the life–mind continuity thesis , 2016, Synthese.

[82]  Karl J. Friston,et al.  From cognitivism to autopoiesis: towards a computational framework for the embodied mind , 2016, Synthese.

[83]  Stavros Demetriadis,et al.  How Does the Degree of Guidance Support Students’ Metacognitive and Problem Solving Skills in Educational Robotics? , 2017, Journal of Science Education and Technology.

[84]  Harold Rosenberg The American Action Painters , 2017, Reading Abstract Expressionism.

[85]  Domen Novak,et al.  Competitive and cooperative arm rehabilitation games played by a patient and unimpaired person: effects on motivation and exercise intensity , 2017, Journal of NeuroEngineering and Rehabilitation.

[86]  S. Gallagher,et al.  4E Cognition. Historical Roots, Key Concepts, and Central Issues , 2018 .

[87]  Karl J. Friston,et al.  The Active Inference Approach to Ecological Perception: General Information Dynamics for Natural and Artificial Embodied Cognition , 2018, Front. Robot. AI.

[88]  A. Newen The Person Model Theory and the Question of Situatedness of Social Understanding , 2018, The Oxford Handbook of 4E Cognition.

[89]  V. Dietz,et al.  Rehabilitation robots for the treatment of sensorimotor deficits: a neurophysiological perspective , 2018, Journal of NeuroEngineering and Rehabilitation.

[90]  S. Gallagher,et al.  The Oxford Handbook of 4E Cognition , 2018 .

[91]  V. Reddy Why Engagement? , 2018, The Oxford Handbook of 4E Cognition.

[92]  Joni Dambre,et al.  Leveraging Robotics Research for Children with Autism: A Review , 2018, International Journal of Social Robotics.

[93]  Hendry Ferreira Chame,et al.  A dynamic computational model of motivation based on self-determination theory and CANN , 2019, Inf. Sci..

[94]  P. Dario,et al.  Improving Executive Functions at School in Children With Special Needs by Educational Robotics , 2020, Frontiers in Psychology.

[95]  Christoph Fuchs,et al.  Psychological reactions to human versus robotic job replacement , 2019, Nature Human Behaviour.

[96]  Jun Tani,et al.  A Novel Predictive-Coding-Inspired Variational RNN Model for Online Prediction and Recognition , 2018, Neural Computation.

[97]  R. Withagen,et al.  What Should A “Gibsonian Neuroscience” Look Like? Introduction to the Special Issue , 2019, Ecological Psychology.

[98]  Erik Rietveld,et al.  What’s Inside Your Head Once You’ve Figured Out What Your Head’s Inside Of , 2019, Ecological Psychology.

[99]  T. Loetscher,et al.  Cognitive rehabilitation for attention deficits following stroke. , 2019, The Cochrane database of systematic reviews.

[100]  J. Tani,et al.  Cognitive and motor compliance in intentional human-robot interaction , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[101]  J. Tani,et al.  Investigation of the Sense of Agency in Social Cognition, Based on Frameworks of Predictive Coding and Active Inference: A Simulation Study on Multimodal Imitative Interaction , 2020, Frontiers in Neurorobotics.

[102]  P. Verschure,et al.  Adaptive conjunctive cognitive training (ACCT) in virtual reality for chronic stroke patients: a randomized controlled pilot trial , 2020, Journal of NeuroEngineering and Rehabilitation.