The human dynamic clamp as a paradigm for social interaction

Significance The human dynamic clamp (HDC) is proposed as a general paradigm for studies of elementary forms of social behavior in complex biological systems. HDC enables parametric control of real-time bidirectional interaction between humans and empirically grounded theoretical models of coordination dynamics. It thus provides necessary experimental access for laboratory investigations, while preserving the reciprocity and open boundary conditions inherent in daily life social interactions. As proof of concept, different implementations are illustrated, ranging from coordination of rhythmic and discrete movements to adaptive and directed behaviors. The HDC may be a powerful tool for blending theory and experiment at different levels of description, from neuronal populations to cognition and social behavior. Social neuroscience has called for new experimental paradigms aimed toward real-time interactions. A distinctive feature of interactions is mutual information exchange: One member of a pair changes in response to the other while simultaneously producing actions that alter the other. Combining mathematical and neurophysiological methods, we introduce a paradigm called the human dynamic clamp (HDC), to directly manipulate the interaction or coupling between a human and a surrogate constructed to behave like a human. Inspired by the dynamic clamp used so productively in cellular neuroscience, the HDC allows a person to interact in real time with a virtual partner itself driven by well-established models of coordination dynamics. People coordinate hand movements with the visually observed movements of a virtual hand, the parameters of which depend on input from the subject’s own movements. We demonstrate that HDC can be extended to cover a broad repertoire of human behavior, including rhythmic and discrete movements, adaptation to changes of pacing, and behavioral skill learning as specified by a virtual “teacher.” We propose HDC as a general paradigm, best implemented when empirically verified theoretical or mathematical models have been developed in a particular scientific field. The HDC paradigm is powerful because it provides an opportunity to explore parameter ranges and perturbations that are not easily accessible in ordinary human interactions. The HDC not only enables to test the veracity of theoretical models, it also illuminates features that are not always apparent in real-time human social interactions and the brain correlates thereof.

[1]  R. Hari,et al.  Brain basis of human social interaction: from concepts to brain imaging. , 2009, Physiological reviews.

[2]  Viktor K. Jirsa,et al.  How do neural connectivity and time delays influence bimanual coordination? , 2007, Biological Cybernetics.

[3]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[4]  J. Koester,et al.  The Role of K+ Currents in Frequency-Dependent Spike Broadening in Aplysia R20 Neurons: A Dynamic-Clamp Analysis , 1996, The Journal of Neuroscience.

[5]  Konrad Paul Kording,et al.  Statistics of Natural Movements Are Reflected in Motor Errors , 2009, Journal of neurophysiology.

[6]  J A Kelso,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987, Journal of experimental psychology. Human perception and performance.

[7]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[8]  A. Ijspeert,et al.  Dynamic hebbian learning in adaptive frequency oscillators , 2006 .

[9]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[10]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[11]  Viktor K. Jirsa,et al.  Theory of the Relation between Human Brain Activity (MEG) and Hand Movements , 2000, NeuroImage.

[12]  A. Ijspeert,et al.  Adaptive Frequency Oscillators and Applications , 2009 .

[13]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[14]  Viktor K. Jirsa,et al.  Nonlinear Dynamics in Human Behavior , 2013, Nonlinear Dynamics in Human Behavior.

[15]  Armin Fuchs,et al.  Nonlinear Dynamics in Complex Systems: Theory and Applications for the Life-, Neuro- and Natural Sciences , 2012 .

[16]  Philip W. Fink,et al.  Local and global stabilization of coordination by sensory information , 2000, Experimental Brain Research.

[17]  Mingzhou Ding,et al.  Spontaneous recruitment and annihilation of degrees of freedom in biological coordination , 1993 .

[18]  Farzan Nadim,et al.  Frequency regulation demonstrated by coupling a model and a biological neuron , 2001, Neurocomputing.

[19]  Viktor K. Jirsa,et al.  Extending the HKB model of coordinated movement to oscillators with different eigenfrequencies , 2004, Biological Cybernetics.

[20]  Viktor K. Jirsa,et al.  Time Scale Hierarchies in the Functional Organization of Complex Behaviors , 2011, PLoS Comput. Biol..

[21]  T. Kohonen Self-organized formation of topographically correct feature maps , 1982 .

[22]  Jacqueline Nadel,et al.  Anatomical Connectivity Influences both Intra- and Inter-Brain Synchronizations , 2012, PloS one.

[23]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[24]  J. Kelso,et al.  The Excitator as a Minimal Model for the Coordination Dynamics of Discrete and Rhythmic Movement Generation , 2005, Journal of motor behavior.

[25]  T I Tóth,et al.  All thalamocortical neurones possess a T‐type Ca2+‘window’ current that enables the expression of bistability‐mediated activities , 1999, The Journal of physiology.

[26]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[27]  Gianfranco Minati Introduction to the Meta-Structures Project: Prospective Applications , 2012 .

[28]  K G Munhall,et al.  Skill acquisition and development: the roles of state-, parameter, and graph dynamics. , 1992, Journal of motor behavior.

[29]  B. Ermentrout,et al.  An adaptive model for synchrony in the firefly Pteroptyx malaccae , 1991 .

[30]  Vitalii I. Goldanskii,et al.  Quantum Chemical Reactions in the Deep Cold , 1986 .

[31]  Christian Lebiere,et al.  Simple games as dynamic, coupled systems: randomness and other emergent properties , 2001, Cognitive Systems Research.

[32]  B. Kendall Nonlinear Dynamics and Chaos , 2001 .

[33]  J. Kelso,et al.  Intentional switching between patterns of bimanual coordination depends on the intrinsic dynamics of the patterns. , 1990, Journal of motor behavior.

[34]  M. Auvray,et al.  Perceptual interactions in a minimalist virtual environment , 2009 .

[35]  J. Kelso,et al.  Dynamics governs switching among patterns of coordination in biological movement , 1988 .

[36]  Kai Vogeley,et al.  A Non-Verbal Turing Test: Differentiating Mind from Machine in Gaze-Based Social Interaction , 2011, PloS one.

[37]  Stefan Schaal,et al.  Reinforcement Learning for Parameterized Motor Primitives , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[38]  Inman Harvey,et al.  Evolutionary Robotics: A New Scientific Tool for Studying Cognition , 2005, Artificial Life.

[39]  O. Sporns,et al.  Towards the virtual brain: network modeling of the intact and the damaged brain. , 2010, Archives italiennes de biologie.

[40]  J A Kelso,et al.  Parametric stabilization of biological coordination: a theoretical model , 2000, Journal of biological physics.

[41]  Armin Fuchs,et al.  Beyond the blank slate: routes to learning new coordination patterns depend on the intrinsic dynamics of the learner—experimental evidence and theoretical model , 2012, Front. Hum. Neurosci..

[42]  Hiroshi Kori,et al.  Engineering Complex Dynamical Structures: Sequential Patterns and Desynchronization , 2007, Science.

[43]  Michael T. Turvey,et al.  Linear and nonlinear stiffness and friction in biological rhythmic movements , 1995, Biological Cybernetics.

[44]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[45]  A. Neuringer,et al.  Approximating Chaotic Behavior , 1993 .

[46]  Line Garnero,et al.  Inter-Brain Synchronization during Social Interaction , 2010, PloS one.

[47]  Manuel Glez Bedia,et al.  Sensorimotor coordination and metastability in a situated HKB model , 2012, Connect. Sci..

[48]  J A Scott Kelso,et al.  Perturbation-Induced False Starts as a Test of the Jirsa-Kelso Excitator Model , 2009, Journal of motor behavior.

[49]  J. A. Scott Kelso,et al.  Phase transitions in oscillatory neural networks , 1992, Defense, Security, and Sensing.

[50]  Guillaume Dumas,et al.  Towards a two-body neuroscience , 2011, Communicative & integrative biology.

[51]  J. A. Scott Kelso,et al.  Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics , 2009, PloS one.

[52]  Vittorio Gallese,et al.  Mirror Neurons and the Evolution of Brain and Language , 2002 .

[53]  Mark W. Woolrich,et al.  Adding dynamics to the Human Connectome Project with MEG , 2013, NeuroImage.

[54]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[55]  Eve Marder,et al.  The dynamic clamp comes of age , 2004, Trends in Neurosciences.

[56]  E. Marder,et al.  Artificial electrical synapses in oscillatory networks. , 1992, Journal of neurophysiology.

[57]  Takashi Ikegami,et al.  The Illusion of Agency: Two Engineering Approaches to Compromise Autonomy and Reactivity in an Artificial System , 2009, Adapt. Behav..

[58]  A. Daffertshofer,et al.  Modeling Rhythmic Interlimb Coordination: Beyond the Haken–Kelso–Bunz Model , 2002, Brain and Cognition.

[59]  Silvia Comani,et al.  Striatal Activity during Intentional Switching Depends on Pattern Stability , 2010, The Journal of Neuroscience.

[60]  Viktor K. Jirsa,et al.  Connecting Cortical and Behavioral Dynamics: Bimanual Coordination , 1998, Neural Computation.

[61]  Manuel Glez Bedia,et al.  The situated HKB model: how sensorimotor spatial coupling can alter oscillatory brain dynamics , 2013, Front. Comput. Neurosci..

[62]  Tom Froese,et al.  Embodied social interaction constitutes social cognition in pairs of humans: A minimalist virtual reality experiment , 2014, Scientific Reports.

[63]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[64]  L. Tsimring,et al.  Generalized synchronization of chaos in directionally coupled chaotic systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[65]  E Marder,et al.  Cellular short-term memory from a slow potassium conductance. , 1996, Journal of neurophysiology.

[66]  Viktor Jirsa,et al.  Functional architectures and structured flows on manifolds: a dynamical framework for motor behavior. , 2014, Psychological review.

[67]  Viktor K. Jirsa,et al.  A theoretical model of phase transitions in the human brain , 1994, Biological Cybernetics.

[68]  R. Miura,et al.  Models of subthreshold membrane resonance in neocortical neurons. , 1996, Journal of neurophysiology.

[69]  Gregor Schöner,et al.  A dynamic pattern theory of behavioral change , 1988 .

[70]  J. A. Scott Kelso,et al.  Outline of a general theory of behavior and brain coordination , 2013, Neural Networks.

[71]  Karl J. Friston What Is Optimal about Motor Control? , 2011, Neuron.

[72]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[73]  Arnaud Revel,et al.  Emergence of structured interactions: From a theoretical model to pragmatic robotics , 2009, Neural Networks.

[74]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[75]  P G Zanone,et al.  Evolution of behavioral attractors with learning: nonequilibrium phase transitions. , 1992, Journal of experimental psychology. Human perception and performance.

[76]  Daniel A. Wagenaar,et al.  The Neurally Controlled Animat: Biological Brains Acting with Simulated Bodies , 2001, Auton. Robots.

[77]  Xabier E. Barandiaran,et al.  Defining Agency: Individuality, Normativity, Asymmetry, and Spatio-temporality in Action , 2009, Adapt. Behav..