Imitating unfamiliar sequences of connected linear motions.

A fundamental challenge in neuroscience is to understand the mechanisms by which multicomponent actions are represented and sequenced for production. We addressed this challenge with a movement-imitation task in which subjects viewed the quasi-random, two-dimensional movements of a disc and then used a stylus to reproduce the remembered trajectory. The stimulus disc moved along straight segments, which differed sufficiently from one another that it was possible to trace individual segments' fate in the resulting movement imitation. A biologically based segmentation algorithm decomposed each imitation into segments whose directions could be compared with those of homologous segments in the model. As the number of linked segments in a stimulus model grew from three to seven, imitation became less accurate, with segments more likely to be deleted, particularly from a model's final stages. When fidelity of imitation was assessed segment by segment, the resulting serial position curves showed a strong primacy effect and a moderate recency effect. Analysis of pairwise transposition errors revealed a striking preponderance of exchanges between adjacent segments that, along with the serial position effects, supports a competitive queuing model of sequencing. In analogy to results with verbal serial recall, repetition of one directed segment in the model reduced imitation quality. Results with longer stimulus models suggest that the segment-by-segment imitation generator may be supplemented in the final stages of imitation by an error-signal driven overlay that produces a late-course, real-time correction. Results are related to neural mechanisms that are known to support sequential motor behavior and working memory.

[1]  M. Makuuchi,et al.  Brain activation during ideomotor praxis: imitation and movements executed by verbal command , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[2]  B. Murdock,et al.  The role of auditory features in memory span for words. , 1980, Journal of experimental psychology. Human learning and memory.

[3]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[4]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[5]  A. Graybiel,et al.  Representation of Action Sequence Boundaries by Macaque Prefrontal Cortical Neurons , 2003, Science.

[6]  M Hallett,et al.  Stimulation over the human supplementary motor area interferes with the organization of future elements in complex motor sequences. , 1997, Brain : a journal of neurology.

[7]  Chris Mellish,et al.  Current research in natural language generation , 1990 .

[8]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[9]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[10]  Seong-Gi Kim,et al.  Cerebellar activation during copying geometrical shapes. , 2003, Journal of neurophysiology.

[11]  J. Tanji Sequential organization of multiple movements: involvement of cortical motor areas. , 2001, Annual review of neuroscience.

[12]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[13]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[14]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[15]  Richard N. Henson,et al.  Serial order in short-term memory , 2001 .

[16]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[17]  Bruno B Averbeck,et al.  Parallel processing of serial movements in prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Jeffery. M. Zacks,et al.  Activation of human motion processing areas during event perception , 2003, Cognitive, affective & behavioral neuroscience.

[19]  Janko Calic,et al.  Temporal Segmentation of MPEG Video Streams , 2002, EURASIP J. Adv. Signal Process..

[20]  K. McDermott,et al.  Factors that determine false recall: A multiple regression analysis , 2001, Psychonomic bulletin & review.

[21]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[22]  M. Matarić,et al.  Fixation behavior in observation and imitation of human movement. , 1998, Brain research. Cognitive brain research.

[23]  A. Bandura,et al.  Developmental psychology : Bandura , Ross and Ross ( 1961 ) Transmission of aggression through imitation of aggressive models , 2015 .

[24]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[25]  A. Drewnowski Attributes and priorities in short-term recall: A new model of memory span. , 1980 .

[26]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[27]  J. F. Soechting,et al.  Haptic synthesis of shapes and sequences. , 2004, Journal of neurophysiology.

[28]  Simon Farrell,et al.  Modelling transposition latencies: Constraints for theories of serial order memory☆ , 2004 .

[29]  Robert Sekuler,et al.  Reproduction of Seen Actions: Stimulus-Selective Learning , 2003, Perception.

[30]  Daniel Bullock,et al.  Adaptive neural models of queuing and timing in fluent action , 2004, Trends in Cognitive Sciences.

[31]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[32]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[33]  Daniel Bullock,et al.  Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives. , 2004, Human movement science.

[34]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[35]  Robert G. Crowder,et al.  The role of one's own voice in immediate memory ☆ , 1970 .

[36]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[37]  Darren Newtson,et al.  The objective basis of behavior units. , 1977 .

[38]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[39]  M M Smyth,et al.  Serial Order in Spatial Immediate Memory , 1996, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[40]  Dylan M. Jones,et al.  Temporal-spatial memory: retrieval of spatial information does not reduce recency. , 2001, Acta psychologica.

[41]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[42]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[43]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[44]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[45]  Apostolos P. Georgopoulos,et al.  I. Single cells encode shape, sequence, and metric parameters , 2003 .

[46]  G. E. Alexander,et al.  Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. , 1998, Journal of neurophysiology.

[47]  C. Heyes Causes and consequences of imitation , 2001, Trends in Cognitive Sciences.

[48]  K. Lashley The problem of serial order in behavior , 1951 .

[49]  J. F. Brown,et al.  The Path of Seen Movement as a Function of the Vector-Field , 1937 .

[50]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[51]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[52]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[54]  R. Blake,et al.  Memory for visual motion. , 1997, Journal of experimental psychology. Human perception and performance.

[55]  Michael S. Gazzaniga,et al.  Creating false memories for visual scenes , 1998, Neuropsychologia.

[56]  M. Mcmahon,et al.  The origin of the oblique effect examined with pattern adaptation and masking. , 2003, Journal of vision.