Beyond the blank slate: routes to learning new coordination patterns depend on the intrinsic dynamics of the learner—experimental evidence and theoretical model

Using an approach that combines experimental studies of bimanual movements to visual stimuli and theoretical modeling, the present paper develops a dynamical account of sensorimotor learning, that is, how new skills are acquired and old ones modified. A significant aspect of our approach is the focus on the individual learner as the basic unit of analysis, in particular the quantification of predispositions and capabilities that the individual learner brings to the learning environment. Such predispositions constitute the learner's behavioral repertoire, captured here theoretically as a dynamical landscape (“intrinsic dynamics”). The learning process is demonstrated to not only lead to a relatively permanent improvement of performance in the required task—the usual outcome—but also to alter the individual's entire repertoire. Changes in the dynamical landscape due to learning are shown to result from two basic mechanisms or “routes”: bifurcation and shift. Which mechanism is selected depends the initial individual repertoire before new learning begins. Both bifurcation and shift mechanisms are accommodated by a dynamical model, a relatively straightforward development of the well-established HKB model of movement coordination. Model simulations show that although environmental or task demands may be met equally well using either mechanism, the bifurcation route results in greater stabilization of the to-be-learned behavior. Thus, stability not (or not only) error is demonstrated to be the basis of selection, both of a new pattern of behavior and the path (smooth shift versus abrupt qualitative change) that learning takes. In line with these results, recent neurophysiological evidence indicates that stability is a relevant feature around which brain activity is organized while an individual performs a coordination task. Finally, we explore the consequences of the dynamical approach to learning for theories of biological change.

[1]  Karl M Newell,et al.  Changes in the structure of children's isometric force variability with practice. , 2004, Journal of experimental child psychology.

[2]  J. A. Scott Kelso,et al.  Instabilities and Phase Transitions in Human Brain and Behavior , 2010, Front. Hum. Neurosci..

[3]  Reint H Geuze,et al.  Bimanual coordination and musical experience: the role of intrinsic dynamics and behavioral information. , 2004, Motor control.

[4]  Pier-Giorgio Zanone,et al.  Motor coordination dynamics underlying graphic motion in 7- to 11-year-old children. , 2012, Journal of experimental child psychology.

[5]  Pier-Giorgio Zanone,et al.  Searching for (Dynamic) Principles of Learning , 2004 .

[6]  W. Köhler The Mentality of Apes. , 2018, Nature.

[7]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[8]  J. A. Scott Kelso,et al.  Coordination Dynamics , 2009, Encyclopedia of Complexity and Systems Science.

[9]  Rob Withagen,et al.  Individual differences in learning to perceive length by dynamic touch: Evidence for variation in perceptual learning capacities , 2009, Attention, perception & psychophysics.

[10]  I. Prigogine,et al.  Formative Processes. (Book Reviews: Self-Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations) , 1977 .

[11]  Sara J. Shettleworth,et al.  Reinforcement and the organization of behavior in golden hamsters: Sunflower seed and nest paper reinforcers , 1978 .

[12]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[13]  Viktor K. Jirsa,et al.  Spatiotemporal re-organization of large-scale neural assemblies underlies bimanual coordination , 2012, NeuroImage.

[14]  J. Kelso,et al.  Environmentally-specified patterns of movement coordination in normal and split-brain subjects , 2004, Experimental Brain Research.

[15]  Vincent S. Huang,et al.  Persistence of motor memories reflects statistics of the learning event. , 2009, Journal of neurophysiology.

[16]  Patrick Dupont,et al.  Motor learning-induced changes in functional brain connectivity as revealed by means of graph-theoretical network analysis , 2012, NeuroImage.

[17]  Fred L. Steinberg,et al.  Cortical and subcortical networks underlying syncopated and synchronized coordination revealed using fMRI , 2002 .

[18]  J. A. Scott Kelso,et al.  Coordination Dynamics of Large-scale Neural Circuitry Underlying Rhythmic Sensorimotor Behavior , 2009, Journal of Cognitive Neuroscience.

[19]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Pier-Giorgio Zanone,et al.  How a new behavioral pattern is stabilized with learning determines its persistence and flexibility in memory , 2006, Experimental Brain Research.

[21]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[22]  J. Kelso,et al.  A synergetic theory of environmentally-specified and learned patterns of movement coordination , 2004, Biological Cybernetics.

[23]  Claire F Michaels,et al.  Information space is action space: perceiving the partial lengths of rods rotated on an axle , 2011, Attention, perception & psychophysics.

[24]  G. Edelman,et al.  Solving Bernstein's problem: a proposal for the development of coordinated movement by selection. , 1993, Child development.

[25]  Claire F. Michaels,et al.  Direct Learning , 2007 .

[26]  R. Schmidt A schema theory of discrete motor skill learning. , 1975 .

[27]  M. Seligman On the generality of the laws of learning , 1970 .

[28]  H. Atmanspacher,et al.  Complementarity in Classical Dynamical Systems , 2006 .

[29]  Didier Delignières,et al.  Preferred coordination modes in the first steps of the learning of a complex gymnastics skill , 1998 .

[30]  J. Schnakenberg,et al.  G. Nicolis und I. Prigogine: Self‐Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations. J. Wiley & Sons, New York, London, Sydney, Toronto 1977. 491 Seiten, Preis: £ 20.–, $ 34.– , 1978 .

[31]  S. P. Swinnen,et al.  Dynamics of learning and transfer of muscular and spatial relative phase in bimanual coordination: evidence for abstract directional codes , 2004, Experimental Brain Research.

[32]  W. Tschacher,et al.  The dynamical systems approach to cognition : concepts and empirical paradigms based on self-organization, embodiment, and coordination dynamics , 2003 .

[33]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[34]  K M Newell,et al.  Variability and Noise in Continuous Force Production , 2000, Journal of motor behavior.

[35]  M. Landy,et al.  Statistical decision theory and trade-offs in the control of motor response. , 2003, Spatial vision.

[36]  Robert A Jacobs,et al.  Adaptive precision pooling of model neuron activities predicts the efficiency of human visual learning. , 2009, Journal of vision.

[37]  G. Schöner,et al.  Learning and recall in a dynamic theory of coordination patterns , 1989, Biological Cybernetics.

[38]  D. Corbetta,et al.  Infants Return to Two-Handed Reaching When They Are Learning to Walk , 2002, Journal of motor behavior.

[39]  Damian G. Stephen,et al.  The role of fractality in perceptual learning: exploration in dynamic touch. , 2010, Journal of experimental psychology. Human perception and performance.

[40]  Ian M. Franks,et al.  Attention focusing instructions and coordination bias : implications for learning a novel bimanual task , 2000 .

[41]  B. Kendall Nonlinear Dynamics and Chaos , 2001 .

[42]  J A Kelso,et al.  Dynamic pattern generation in behavioral and neural systems. , 1988, Science.

[43]  John B. Watson,et al.  Some experiments bearing upon color vision in monkeys , 1909 .

[44]  P G Zanone,et al.  Evolution of behavioral attractors with learning: nonequilibrium phase transitions. , 1992, Journal of experimental psychology. Human perception and performance.

[45]  W. Ebeling,et al.  Synergetics. Chaos, Order, Self-Organization , 1995 .

[46]  D. Chialvo Emergent complex neural dynamics , 2010, 1010.2530.

[47]  W. Timberlake,et al.  Behavior Systems and Learning: From Misbehavior to General Principles , 2019, Contemporary Learning Theories.

[48]  N. Eldredge,et al.  Punctuated equilibrium comes of age , 1993, Nature.

[49]  M E Bitterman,et al.  The comparative analysis of learning. , 1975, Science.

[50]  J. Kelso,et al.  Coordination dynamics of learning and transfer: collective and component levels. , 1997, Journal of experimental psychology. Human perception and performance.

[51]  L. Cohen,et al.  Transitions between dynamical states of differing stability in the human brain , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[52]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[53]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[54]  J. Kelso,et al.  A synergetic theory of environmentally-specified and learned patterns of movement coordination , 2004, Biological Cybernetics.

[55]  E. Thelen Self organizing systems and infant motor development , 1987 .

[56]  B. Hommel,et al.  Effect anticipation and action control. , 2001, Journal of experimental psychology. Human perception and performance.

[57]  Konrad Paul Kording,et al.  Estimating the sources of motor errors for adaptation and generalization , 2008, Nature Neuroscience.

[58]  M. Landy,et al.  Bayesian Modelling of Visual Perception , 2002 .

[59]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[60]  R. Root-Bernstein,et al.  Molecular complementarity I: the complementarity theory of the origin and evolution of life. , 1997, Journal of theoretical biology.

[61]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[62]  D. Cheyne,et al.  Dynamic cortical activity in the human brain reveals motor equivalence , 1998, Nature.

[63]  W. Timberlake Natural learning in laboratory paradigms. , 1990 .

[64]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[65]  J. Kelso,et al.  Nonequilibrium phase transitions in coordinated biological motion: critical fluctuations , 1986 .

[66]  B. F. Skinner,et al.  Can psychology be a science of mind , 1990 .

[67]  Konrad Paul Kording,et al.  Statistics of Natural Movements Are Reflected in Motor Errors , 2009, Journal of neurophysiology.

[68]  Stephan P. Swinnen,et al.  Acquisition of a new bimanual coordination pattern modulates the cerebral activations elicited by an intrinsic pattern: An fMRI study , 2008, Cortex.

[69]  J. Stevens,et al.  Animal Intelligence , 1883, Nature.

[70]  Viktor K. Jirsa,et al.  A dynamical approach to speech categorization: Two routes to learning , 2008 .

[71]  P. N. Kugler,et al.  1 On the Concept of Coordinative Structures as Dissipative Structures: I. Theoretical Lines of Convergence* , 1980 .

[72]  Karl M. Newell,et al.  Is Variability in Human Performance a Reflection of System Noise? , 1998 .

[73]  J. S. Scott Kelso,et al.  Haptic information stabilizes and destabilizes coordination dynamics , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[74]  Mitsuo Kawato,et al.  Two coupled oscillators as a model for the coordinated finger tapping by both hands , 1980, Biological Cybernetics.

[75]  H. Haken Synergetics: an Introduction, Nonequilibrium Phase Transitions and Self-organization in Physics, Chemistry, and Biology , 1977 .

[76]  J. Kelso,et al.  The Complementary Nature , 2006 .

[77]  P. N. Kugler,et al.  On the concept of coordinative structures as dissipative structures: i , 1980 .

[78]  Pier-Giorgio Zanone,et al.  The Coordination Dynamics of Learning: Theoretical Structure and Experimental Agenda , 1994 .

[79]  Robert F. Port,et al.  Meter and speech , 2003, J. Phonetics.

[80]  Romeo Chua,et al.  The Role of Video in Facilitating Perception and Action of a Novel Coordination Movement , 2003, Journal of motor behavior.

[81]  S. Carpenter,et al.  Early-warning signals for critical transitions , 2009, Nature.

[82]  John Garcia,et al.  Behavioral Regulation of the Milieu Interne in Man and Rat , 1974, Science.

[83]  A. Fuchs,et al.  A phase transition in human brain and behavior , 1992 .

[84]  J. Krakauer,et al.  Human sensorimotor learning: adaptation, skill, and beyond , 2011, Current Opinion in Neurobiology.

[85]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[86]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[87]  Karl M Newell,et al.  Learning to coordinate redundant degrees of freedom in a dynamic balance task. , 2003, Human movement science.

[88]  J. A. S. Kelso,et al.  Practice-dependent modulation of neural activity during human sensorimotor coordination: a functional Magnetic Resonance Imaging study , 2002, Neuroscience Letters.

[89]  J. Jacques Temprado,et al.  A novice-expert comparison of (intra-limb) coordination subserving the volleyball serve , 1997 .

[90]  Juraj Simko,et al.  Embodied task dynamics. , 2010, Psychological review.

[91]  Hermann Haken,et al.  Synergetics: An Introduction , 1983 .

[92]  J. Temprado,et al.  Covariation of attentional cost and stability provides further evidence for two routes to learning new coordination patterns. , 2010, Acta psychologica.

[93]  M. Roberton,et al.  Individual Pathways in the Development of Forceful Throwing , 2002, Research quarterly for exercise and sport.

[94]  J. Kelso,et al.  Learning as change of coordination dynamics: theory and experiment. , 1992, Journal of motor behavior.

[95]  J. Adams,et al.  A closed-loop theory of motor learning. , 1971, Journal of motor behavior.

[96]  D. M. Jacobs,et al.  Learning to perceive the relative mass of colliding balls: The effects of ratio scaling and feedback , 2000, Perception & psychophysics.

[97]  Ian M Franks,et al.  Learning as a function of coordination bias: building upon pre-practice behaviours. , 2002, Human movement science.

[98]  Karl M. Newell,et al.  Human learning: Power laws or multiple characteristic time scales? , 2006 .

[99]  James O. Berger Statistical Decision Theory , 1980 .

[100]  J. Kelso,et al.  Nonequilibrium phase transitions in coordinated biological motion: Critical slowing down and switching time , 1987 .

[101]  J. Kelso,et al.  Evolution of behavioral attractors with learning: nonequilibrium phase transitions. , 1992 .

[102]  Elise Faugloire,et al.  (De)stabilization of required and spontaneous postural dynamics with learning. , 2009, Journal of experimental psychology. Human perception and performance.

[103]  J. Kelso,et al.  Theoretical concepts and strategies for understanding perceptual-motor skill: from information capacity in closed systems to self-organization in open, nonequilibrium systems. , 1992, Journal of experimental psychology. General.

[104]  J. Kelso,et al.  Coordination dynamics of learning and transfer across different effector systems. , 2002, Journal of experimental psychology. Human perception and performance.

[105]  J. Smallwood,et al.  The restless mind. , 2006, Psychological bulletin.

[106]  S. Pinker The Blank Slate: The Modern Denial of Human Nature , 2002 .

[107]  P. J. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[108]  J. Kelso Principles of Dynamic Pattern Formation and Change for a Science of Human Behavior , 2000 .

[109]  S. Swinnen Intermanual coordination: From behavioural principles to neural-network interactions , 2002, Nature Reviews Neuroscience.

[110]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[111]  T. Johnston Contrasting approaches to a theory of learning , 1981, Behavioral and Brain Sciences.

[112]  J. Kelso,et al.  Phase Transitions in Speech Production and Their Perceptual Consequences , 1989, Attention and Performance XIII.

[113]  Pier-Giorgio Zanone,et al.  The Role of Stability in the Dynamics of Learning, Memorizing, and Forgetting New Coordination Patterns , 2008, Journal of motor behavior.

[114]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[115]  H. Haken,et al.  Phase-locked modes, phase transitions and component oscillators in biological motion , 1987 .

[116]  P J Beek,et al.  Movement-Related Sensory Feedback Mediates the Learning of a New Bimanual Relative Phase Pattern , 2005, Journal of motor behavior.

[117]  Marcus E Raichle,et al.  Intrinsic brain activity sets the stage for expression of motivated behavior , 2005, The Journal of comparative neurology.

[118]  H. Haken,et al.  A stochastic theory of phase transitions in human hand movement , 1986, Biological Cybernetics.

[119]  J. Kelso,et al.  Binding of movement, sound and touch: multimodal coordination dynamics , 2006, Experimental Brain Research.

[120]  J. Kelso Phase transitions and critical behavior in human bimanual coordination. , 1984, The American journal of physiology.

[121]  K. Newell Motor skill acquisition. , 1991, Annual review of psychology.

[122]  Pier-Giorgio Zanone,et al.  Learning and transfer as dynamical paradigms for behavioral change , 1992 .

[123]  K. Breland,et al.  The misbehavior of organisms. , 1961 .

[124]  Dana Maslovat,et al.  Evaluation of scanning methodology in bimanual coordination. , 2005, Motor control.

[125]  Ivar Hagendoorn,et al.  Cognitive Dance Improvisation: How Study of the Motor System Can Inspire Dance (and Vice Versa) , 2003, Leonardo.

[126]  A. Rouard,et al.  Dynamics of coordination in cross-country skiing. , 2009, Human movement science.