Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives.

A wave of recent behavioral studies has generated a new wealth of parametric observations about serial order behavior. What was a trickle of neurophysiological studies has grown to a steady stream of probes of neural sites and mechanisms underlying sequential behavior. Moreover, simulation models of serial behavior generation have begun to open a channel to link cellular dynamics with cognitive and behavioral dynamics. Here we review major results from prominent sequence learning and performance tasks, namely immediate serial recall, typing, 2 x N, discrete sequence production, and serial reaction time. These tasks populate a continuum from higher to lower degrees of internal control of sequential organization and probe important contemporary issues such as the nature of working-memory representations for sequential behavior, and the development and role of chunks in hierarchical control. The main movement classes reviewed are speech and keypressing, both involving small amplitude movements amenable to parametric study. A synopsis of serial order models, vis-a-vis major empirical findings leads to a focus on competitive queuing (CQ) models. Recently, the many behavioral predictive successes of CQ models have been complemented by successful prediction of distinctively patterned electrophysiological recordings. In lateral prefrontal cortex, parallel activation dynamics of multiple neural ensembles strikingly matches the parallel dynamics predicted by CQ theory. An extended CQ simulation model--the N-STREAMS neural network model--exemplifies ongoing attempts to accommodate a broad range of both behavioral and neurobiological data within a CQ-consistent theory.

[1]  A. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental brain research.

[2]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[3]  Axel Cleeremans,et al.  Implicit learning: news from the front , 1998, Trends in Cognitive Sciences.

[4]  M. Inase,et al.  Selective coding of motor sequence in the supplementary motor area of the monkey cerebral cortex , 2004, Experimental Brain Research.

[5]  A W Inhoff,et al.  Programming and execution of sequential movements in Parkinson's disease. , 1987, Journal of neurology, neurosurgery, and psychiatry.

[6]  H Heuer,et al.  Testing the invariance of relative timing: comment on Gentner (1987). , 1988, Psychological review.

[7]  Chris Mellish,et al.  Current research in natural language generation , 1990 .

[8]  Stephen Grossberg,et al.  A neural network model for cursive script production , 1993, Biological Cybernetics.

[9]  Richard I. Ivry,et al.  Attention and Structure in Sequence Learning , 2004 .

[10]  Norman H Freeman,et al.  Regulation of division of labour between cognitive systems controlling action , 2000, Cognition.

[11]  N Cowan,et al.  Think before you speak: pauses, memory search, and trace redintegration processes in verbal memory span. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[12]  G. Dell,et al.  Language production and serial order: a functional analysis and a model. , 1997, Psychological review.

[13]  D. Broadbent Levels, Hierarchies, and the Locus of Control* , 1977 .

[14]  F. M. Henry,et al.  Increased Response Latency for Complicated Movements and A “Memory Drum” Theory of Neuromotor Reaction , 1960 .

[15]  J. Ashe,et al.  Cerebellum Activation Associated with Performance Change but Not Motor Learning , 2002, Science.

[16]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[17]  Stefano Vicari,et al.  Implicit and explicit memory: a functional dissociation in persons with Down syndrome , 2000, Neuropsychologia.

[18]  John W. Scott,et al.  Selected Writings of John Hughlings Jackson , 1959 .

[19]  L. Squire,et al.  Encapsulation of Implicit and Explicit Memory in Sequence Learning , 1998, Journal of Cognitive Neuroscience.

[20]  Dylan M. Jones,et al.  Irrelevant tones produce an irrelevant speech effect : Implications for phonological coding in working memory , 1993 .

[21]  Daniel B. Willingham,et al.  On the development of procedural knowledge. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[22]  R. Ivry,et al.  The role of cerebellar structures in the execution of serial movements. , 1989, Brain : a journal of neurology.

[23]  M Eimer,et al.  Explicit and implicit learning of event sequences: evidence from event-related brain potentials. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[24]  S. Grossberg,et al.  Metabotropic Glutamate Receptor Activation in Cerebellar Purkinje Cells as Substrate for Adaptive Timing of the Classically Conditioned Eye-Blink Response , 1996, The Journal of Neuroscience.

[25]  J. Doyon,et al.  Role of the Striatum, Cerebellum, and Frontal Lobes in the Learning of a Visuomotor Sequence , 1997, Brain and Cognition.

[26]  Charles J. Fillmore,et al.  The Mechanisms of “Construction Grammar” , 1988 .

[27]  Miya K. Rand,et al.  Characteristics of sequential movements during early learning period in monkeys , 2000, Experimental Brain Research.

[28]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[29]  J Tanji,et al.  Role for cells in the presupplementary motor area in updating motor plans. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[30]  G. Stelmach Information processing in motor control and learning , 1978 .

[31]  T. Carr,et al.  Automaticity in skill acquisition: Mechanisms for reducing interference in concurrent performance. , 1989 .

[32]  Stephen Grossberg,et al.  STORE working memory networks for storage and recall of arbitrary temporal sequences , 1994, Biological Cybernetics.

[33]  William B Verwey,et al.  Evidence for Lasting Sequence Segmentation in the Discrete Sequence-Production Task , 2003, Journal of motor behavior.

[34]  M G Fischman,et al.  Simple reaction time as a function of response complexity: memory drum theory revisited. , 1982, Journal of motor behavior.

[35]  Alan D. Baddeley,et al.  Disruption of short-term memory by unattended speech : Implications for the structure of working memory , 1982 .

[36]  Michael I. Jordan Serial Order: A Parallel Distributed Processing Approach , 1997 .

[37]  Diana Eugenie Kornbrot Organisation of keying skills : the effect of motor complexity and number of units , 1989 .

[38]  D A Rosenbaum,et al.  Hierarchical control of rapid movement sequences. , 1983, Journal of experimental psychology. Human perception and performance.

[39]  Nigel Ward A connectionist language generator , 1994, Ablex series in artificial intelligence.

[40]  J. Adams Learning of movement sequences , 1984 .

[41]  T. Salthouse Perceptual, cognitive, and motoric aspects of transcription typing. , 1986, Psychological bulletin.

[42]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[43]  Stephen Grossberg,et al.  Neural dynamics of adaptive sensory-motor control , 1986 .

[44]  Frank N. Freeman,et al.  Preliminary experiments on writing and reactions. , 2022 .

[45]  M. Inase,et al.  Neuronal activity in the primate premotor, supplementary, and precentral motor cortex during visually guided and internally determined sequential movements. , 1991, Journal of neurophysiology.

[46]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[47]  P. Strick,et al.  An unfolded map of the cerebellar dentate nucleus and its projections to the cerebral cortex. , 2003, Journal of neurophysiology.

[48]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[49]  A. Treisman Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[50]  O. Hikosaka,et al.  Transition of Brain Activation from Frontal to Parietal Areas in Visuomotor Sequence Learning , 1998, The Journal of Neuroscience.

[51]  Jack van Honk,et al.  On the role of the SMA in the discrete sequence production task: a TMS study , 2002, Neuropsychologia.

[52]  O. Hikosaka,et al.  Characteristics of a long-term procedural skill in the monkey , 1998, Experimental Brain Research.

[53]  Bruno B Averbeck,et al.  Parallel processing of serial movements in prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[54]  Peter Ford Dominey,et al.  A cortico-subcortical model for generation of spatially accurate sequential saccades. , 1992, Cerebral cortex.

[55]  A W Inhoff,et al.  Cerebellar structures and the programming of movement sequences. , 1990, Behavioural neurology.

[56]  I Neath,et al.  Word-length effects in immediate memory: Overwriting trace decay theory , 1995, Psychonomic bulletin & review.

[57]  H van Mier,et al.  The effects of motor complexity and practice on initiation time in writing and drawing. , 1993, Acta psychologica.

[58]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[59]  D. Spalding The Principles of Psychology , 1873, Nature.

[60]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[61]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[62]  W. Verwey Effect of Sequence Length on the Execution of Familiar Keying Sequences: Lasting Segmentation and Preparation? , 2003, Journal of motor behavior.

[63]  Daniel Bullock,et al.  A neural network model of serial order recall from short-term memory , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[64]  Stephex GROSSBERGl Behavioral Contrast in Short Term Memory : Serial Binary Memory Models or Parallel Continuous Memory Models ? , 2003 .

[65]  M. Mauk,et al.  Cerebellar cortex lesions disrupt learning-dependent timing of conditioned eyelid responses , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  W. Bruce Croft Radical Construction Grammar , 2001 .

[67]  T. Hartley,et al.  A Linguistically Constrained Model of Short-Term Memory for Nonwords ☆ , 1996 .

[68]  Benjamin A Clegg,et al.  Effector dependent sequence learning in the serial RT task , 2005, Psychological research.

[69]  J. Kalaska,et al.  Simultaneous encoding of multiple potential reach directions in dorsal premotor cortex. , 2002, Journal of neurophysiology.

[70]  Nelson Cowan,et al.  Mechanisms of Verbal Short-Term Memory , 1994 .

[71]  D. Meyer,et al.  Control of Serial Order in Rapidly Spoken Syllable Sequences , 1987 .

[72]  K. M. Newell,et al.  Some Issues on Action Plans , 1978 .

[73]  Richard S. J. Frackowiak,et al.  A Blueprint for Movement: Functional and Anatomical Representations in the Human Motor System , 1999, The Journal of Neuroscience.

[74]  K. Lashley THE ACCURACY OF MOVEMENT IN THE ABSENCE OF EXCITATION FROM THE MOVING ORGAN , 1917 .

[75]  R. Conrad,et al.  Accuracy of recall using keyset and telephone dial, and the effect of a prefix digit. , 1958 .

[76]  Gerard P. van Galen,et al.  Levels of Motor Programming in Writing Familiar and Unfamiliar Symbols , 1988 .

[77]  Willem B. Verwey,et al.  Evidence for a multistage model of practice in a sequential movement task. , 1999 .

[78]  Axel Cleeremans,et al.  Comparing direct and indirect measures of sequence learning , 1996 .

[79]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[80]  D. Shanks,et al.  Characteristics of dissociable human learning systems , 1994, Behavioral and Brain Sciences.

[81]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[82]  Willem B Verwey,et al.  Processing modes and parallel processors in producing familiar keying sequences , 2003, Psychological research.

[83]  Scott T. Grafton,et al.  Functional Mapping of Sequence Learning in Normal Humans , 1995, Journal of Cognitive Neuroscience.

[84]  G. E. Alexander,et al.  Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. , 1998, Journal of neurophysiology.

[85]  M. A. Basso,et al.  Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability , 1998, The Journal of Neuroscience.

[86]  D J Povel,et al.  Structural factors in patterned finger tapping. , 1982, Acta psychologica.

[87]  O Hikosaka,et al.  Effects of local inactivation of monkey medial frontal cortex in learning of sequential procedures. , 1999, Journal of neurophysiology.

[88]  B. MacWhinney,et al.  Vocabulary Acquisition and Verbal Short-Term Memory: Computational and Neural Bases , 1997, Brain and Language.

[89]  R. Jansen,et al.  LANGUAGE ACQUISITION , 1977, The Medical journal of Australia.

[90]  A. Gordon,et al.  Choosing between movement sequences: A hierarchical editor model. , 1984 .

[91]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[92]  A Semjen,et al.  Planning and timing of finger-tapping sequences with a stressed element. , 1986, Journal of motor behavior.

[93]  Christian Mannes Neural network models of serial order and handwriting movement generation , 1994 .

[94]  R. Stevens,et al.  Aspects of Consciousness: Volume 1, Psychological Issues , 1979 .

[95]  O. Hikosaka,et al.  Role of monkey cerebellar nuclei in skill for sequential movement. , 1998, Journal of neurophysiology.

[96]  Axel Cleeremans,et al.  Can sequence learning be implicit? New evidence with the process dissociation procedure , 2001, Psychonomic bulletin & review.

[97]  Rna Henson,et al.  Short-term memory for serial order. , 2001 .

[98]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[99]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[100]  H P BAHRICK,et al.  Extra-task performance as a measure of learning a primary task. , 1954, Journal of experimental psychology.

[101]  Morten H. Christiansen,et al.  Sequential learning in non-human primates , 2001, Trends in Cognitive Sciences.

[102]  MICHAEL P. A. PAGE Modelling the Perception of Musical Sequences with Self-organizing Neural Networks , 1994, Connect. Sci..

[103]  W. L. Gard,et al.  The Psychology of Skill. , 1947, British medical journal.

[104]  G. Waters,et al.  Articulatory and Phonological Determinants of Word Length Effects in Span Tasks , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[105]  P. Cz. Handbuch der physiologischen Optik , 1896 .

[106]  Luis Jiménez,et al.  Measures of awareness and of sequence knowledge , 1996 .

[107]  W B Verwey,et al.  Concatenating familiar movement sequences: the versatile cognitive processor. , 2001, Acta psychologica.

[108]  Daniel Bullock,et al.  A Scalable Model of Cerebellar Adaptive Timing and Sequencing: The Recurrent Slide and Latch (RSL) Model , 2002, Applied Intelligence.

[109]  K. Doya,et al.  Parallel neural networks for learning sequential procedures , 1999, Trends in Neurosciences.

[110]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[111]  Nelson Cowan,et al.  Reconfirmation of the Short-Term Storage Concept , 1994 .

[112]  D. Bullock,et al.  Reconciling stable asymmetry with recovery of function: an adaptive systems perspective on functional plasticity. , 1987, Child development.

[113]  O. Hikosaka,et al.  Chunking during human visuomotor sequence learning , 2003, Experimental Brain Research.

[114]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[115]  Frank Restle,et al.  Theory of Serial Pattern Learning: Structural Trees. , 1970 .

[116]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[117]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[118]  David A. Rosenbaum,et al.  Successive Approximations to a Model of Human Motor Programming , 1988 .

[119]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[120]  Scott T. Grafton,et al.  Attention and stimulus characteristics determine the locus of motor-sequence encoding. A PET study. , 1997, Brain : a journal of neurology.

[121]  E. Vakil,et al.  Motor and non-motor sequence learning in patients with basal ganglia lesions: the case of serial reaction time (SRT) , 2000, Neuropsychologia.

[122]  N. Burgess,et al.  Toward a network model of the articulatory loop , 1992, Connectionist psychology: A text with readings.

[123]  Sheila Lennon,et al.  Advances in Motor Learning and Control , 1997 .

[124]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[125]  S. T. Klapp,et al.  Motor response programming during simple choice reaction time: The role of practice. , 1995 .

[126]  Ian Boardman Neural network models of temporal processing in speech perception and motor control , 1995 .

[127]  W. B. Verwey,et al.  A Forthcoming Key Press Can Be Selected While Earlier Ones Are Executed. , 1993, Journal of motor behavior.

[128]  A. Colley,et al.  Cognition and action in skilled behaviour , 1988 .

[129]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[130]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[131]  A. Battersby Plans and the Structure of Behavior , 1968 .

[132]  Wayne A. Wickelgran Context-sensitive coding, associative memory, and serial order in (speech) behavior. , 1969 .

[133]  S. Keele,et al.  The cognitive and neural architecture of sequence representation. , 2003, Psychological review.

[134]  Stephen Monsell,et al.  The Latency and Duration of Rapid Movement Sequences: Comparisons of Speech and Typewriting , 1978 .

[135]  Steven Laureys,et al.  Cerebral correlates of explicit sequence learning. , 2003, Brain research. Cognitive brain research.

[136]  David L Wright,et al.  Effector-independent and effector-dependent learning in the discrete sequence production task , 2004, Psychological research.

[137]  J G Anson,et al.  Memory drum theory: alternative tests and explanations for the complexity effects on simple reaction time. , 1982, Journal of motor behavior.

[138]  K. Lashley The problem of serial order in behavior , 1951 .

[139]  Willem B. Verwey,et al.  Evidence for the development of concurrent processing in a sequential keypressing task , 1994 .

[140]  A D Baddeley,et al.  How Does Acoustic Similarity Influence Short-Term Memory? , 1968, The Quarterly journal of experimental psychology.

[141]  José Luis Contreras-Vidal,et al.  Neural dynamics of short and medium-term motor control effects of levodopa therapy in Parkinson's disease , 1998, Artif. Intell. Medicine.

[142]  S. Grossberg The Adaptive Self-Organization of Serial Order in Behavior: Speech, Language, And Motor Control , 1987 .

[143]  G. Pellizzer,et al.  Motor planning: effect of directional uncertainty with discrete spatial cues , 2003, Experimental Brain Research.

[144]  David A. Rosenbaum,et al.  A Motor-Program Editor , 1984 .

[145]  O. Hikosaka,et al.  Anticipatory saccades in sequential procedural learning in monkeys. , 1996, Journal of neurophysiology.

[146]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[147]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[148]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[149]  M. Amorim,et al.  Conscious knowledge and changes in performance in sequence learning: evidence against dissociation. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[150]  S E Avons,et al.  The Word-length Effect and Disyllabic Words , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[151]  O. Hikosaka,et al.  Activation of human presupplementary motor area in learning of sequential procedures: a functional MRI study. , 1996, Journal of neurophysiology.

[152]  S. E. Avons,et al.  Output Decay in Immediate Serial Recall: Speech Time Revisited ☆ , 2002 .

[153]  J. Reason Actions not as planned : The price of automatisation , 1979 .

[154]  Alan B. Welsh,et al.  Acoustic masking in primary memory. , 1976 .

[155]  F M Henry,et al.  Use of simple reaction time in motor programming studies: a reply to Klapp, Wyatt and Lingo. , 1980, Journal of motor behavior.

[156]  Howard N. Zelaznik,et al.  Advances in Motor Learning and Control , 1996 .

[157]  Dylan M. Jones,et al.  Privileged Access by Irrelevant Speech to Short-term Memory: The Role of Changing State , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[158]  W. Verwey BUFFER LOADING AND CHUNKING IN SEQUENTIAL KEYPRESSING , 1996 .

[159]  Daniel Bullock,et al.  Competitive Queing for Planning and Serial Performance , 2002 .

[160]  D. Balota,et al.  Implicit Memory and the Formation of New Associations in Nondemented Parkinson′s Disease Individuals and Individuals with Senile Dementia of the Alzheimer Type: A Serial Reaction Time (SRT) Investigation , 1993, Brain and Cognition.

[161]  D. G. MacKay The Problems of Flexibility, Fluency, and Speed-Accuracy Trade-Off in Skilled Behavior. , 1982 .

[162]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[163]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[164]  R. B. Freeman,et al.  Cognition and Motor Processes , 1983 .

[165]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[166]  W Spijkers,et al.  Effects of sleep loss, time of day, and extended mental work on implicit and explicit learning of sequences. , 1998, Journal of experimental psychology. Applied.