Recognition of dance-like actions: Memory for static posture or dynamic movement?

Dance-like actions are complex visual stimuli involving multiple changes in body posture across time and space. Visual perception research has demonstrated a difference between the processing of dynamic body movement and the processing of static body posture. Yet, it is unclear whether this processing dissociation continues during the retention of body movement and body form in visual working memory (VWM). When observing a dance-like action, it is likely that static snapshot images of body posture will be retained alongside dynamic images of the complete motion. Therefore, we hypothesized that, as in perception, posture and movement would differ in VWM. Additionally, if body posture and body movement are separable in VWM, as form- and motion-based items, respectively, then differential interference from intervening form and motion tasks should occur during recognition. In two experiments, we examined these hypotheses. In Experiment 1, the recognition of postures and movements was tested in conditions in which the formats of the study and test stimuli matched (movement–study to movement–test, posture–study to posture–test) or mismatched (movement–study to posture–test, posture–study to movement–test). In Experiment 2, the recognition of postures and movements was compared after intervening form and motion tasks. These results indicated that (1) the recognition of body movement based only on posture is possible, but it is significantly poorer than recognition based on the entire movement stimulus, and (2) form-based interference does not impair memory for movements, although motion-based interference does. We concluded that, whereas static posture information is encoded during the observation of dance-like actions, body movement and body posture differ in VWM.

[1]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[2]  Janet Adshead-Lansdale,et al.  Dance analysis : theory and practice , 1988 .

[3]  Dylan M. Jones,et al.  Perceptual organization masquerading as phonological storage: Further support for a perceptual-gestural view of short-term memory , 2006 .

[4]  Robert H. Logie,et al.  Spatial Working Memory , 2011 .

[5]  Nelson Cowan,et al.  How Can Dual-Task Working Memory Retention Limits Be Investigated? , 2007, Psychological science.

[6]  Alison J. Wiggett,et al.  The role of the extrastriate body area in action perception , 2006, Social neuroscience.

[7]  R. Logie The Functional Organization and Capacity Limits of Working Memory , 2011 .

[8]  J A Beintema,et al.  Perception of biological motion without local image motion , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[9]  R. Blake,et al.  Brain activity evoked by inverted and imagined biological motion , 2001, Vision Research.

[10]  D. Berch,et al.  The Corsi Block-Tapping Task: Methodological and Theoretical Considerations , 1998, Brain and Cognition.

[11]  M M Smyth,et al.  Working Memory for Movements , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[12]  W. Dittrich Action Categories and the Perception of Biological Motion , 1993, Perception.

[13]  Edward E. Smith,et al.  Neuroimaging studies of working memory: , 2003, Cognitive, affective & behavioral neuroscience.

[14]  N. Cowan,et al.  The Magical Mystery Four , 2010, Current directions in psychological science.

[15]  Klaus Oberauer,et al.  Accessing information in working memory: can the focus of attention grasp two elements at the same time? , 2009, Journal of experimental psychology. General.

[16]  P. Jolicœur,et al.  Visual short-term memory: Central capacity limitations in short-term consolidation , 2007 .

[17]  Margaret Wilson The case for sensorimotor coding in working memory , 2001, Psychonomic bulletin & review.

[18]  A. Baddeley,et al.  Pattern span: a tool for unwelding visuo–spatial memory , 1999, Neuropsychologia.

[19]  J. Freyd,et al.  Timing and Apparent Motion Path Choice With Human Body Photographs , 1993 .

[20]  Steven J. Luck,et al.  Visual short term memory , 2007, Scholarpedia.

[21]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[22]  R. Engle Role of Working‐Memory Capacity in Cognitive Control , 2010, Current Anthropology.

[23]  Cosimo Urgesi,et al.  Magnetic Stimulation of Extrastriate Body Area Impairs Visual Processing of Nonfacial Body Parts , 2004, Current Biology.

[24]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[25]  Luca Cocchi,et al.  Visuo-spatial processing in a dynamic and a static working memory paradigm in schizophrenia , 2007, Psychiatry Research.

[26]  Hubert D. Zimmer,et al.  Visual and spatial working memory: From boxes to networks , 2008, Neuroscience & Biobehavioral Reviews.

[27]  André Vandierendonck,et al.  Evidence for Modality-Independent Order Coding in Working Memory , 2009, Quarterly journal of experimental psychology.

[28]  Andrew R. A. Conway,et al.  On the capacity of attention: Its estimation and its role in working memory and cognitive aptitudes , 2005, Cognitive Psychology.

[29]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[30]  S. Pickering,et al.  Development of Memory for Pattern and Path: Further Evidence for the Fractionation of Visuo-Spatial Memory , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[31]  G. Orban,et al.  Specificity of regions processing biological motion , 2005, The European journal of neuroscience.

[32]  Dylan M. Jones,et al.  Functional equivalence of verbal and spatial information in serial short-term memory. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[33]  C. Rossi-Arnaud,et al.  Working memory for ballet moves and spatial locations in professional ballet dancers , 2010 .

[34]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[35]  P. Downing,et al.  The neural basis of visual body perception , 2007, Nature Reviews Neuroscience.

[36]  Tjeerd Jellema,et al.  Cells in monkey STS responsive to articulated body motions and consequent static posture: a case of implied motion? , 2003, Neuropsychologia.

[37]  Oded M. Flascher,et al.  Dimensions of Event Perception , 1996 .

[38]  Preston P. Thakral,et al.  Memory for motion and spatial location is mediated by contralateral and ipsilateral motion processing cortex , 2011, NeuroImage.

[39]  Barbara Tillmann,et al.  Unspoken knowledge: implicit learning of structured human dance movement. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[40]  B. Mynatt,et al.  Reaction times in a bisensory task: implications for attention and speech perception. , 1977, Journal of experimental psychology. Human perception and performance.

[41]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[42]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[43]  Dylan M. Jones,et al.  The impact of order incongruence between a task-irrelevant auditory sequence and a task-relevant visual sequence. , 2005, Journal of experimental psychology. Human perception and performance.

[44]  Kenneth I Forster,et al.  DMDX: A Windows display program with millisecond accuracy , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[45]  Hubert D. Zimmer,et al.  fMRI correlates of working memory: Specific posterior representation sites for motion and position information , 2011, Brain Research.

[46]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[47]  Justin N. Wood Visual working memory for observed actions. , 2007, Journal of experimental psychology. General.