Posture-based processing in visual short-term memory for actions

Visual perception of human action involves both form and motion processing, which may rely on partially dissociable neural networks. If form and motion are dissociable during visual perception, then they may also be dissociable during their retention in visual short-term memory (VSTM). To elicit form-plus-motion and form-only processing of dance-like actions, individual action frames can be presented in the correct or incorrect order. The former appears coherent and should elicit action perception, engaging both form and motion pathways, whereas the latter appears incoherent and should elicit posture perception, engaging form pathways alone. It was hypothesized that, if form and motion are dissociable in VSTM, then recognition of static body posture should be better after viewing incoherent than after viewing coherent actions. However, as VSTM is capacity limited, posture-based encoding of actions may be ineffective with increased number of items or frames. Using a behavioural change detection task, recognition of a single test posture was significantly more likely after studying incoherent than after studying coherent stimuli. However, this effect only occurred for spans of two (but not three) items and for stimuli with five (but not nine) frames. As in perception, posture and motion are dissociable in VSTM.

[1]  Sheba Heptulla Chatterjee,et al.  Configural processing in the perception of apparent biological motion. , 1996, Journal of experimental psychology. Human perception and performance.

[2]  B. Calvo-Merino,et al.  Dance as a subject for empirical aesthetics. , 2013 .

[3]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[4]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[5]  Catherine J. Stevens,et al.  Recognition of dance-like actions: Memory for static posture or dynamic movement? , 2014, Memory & cognition.

[6]  W. Dittrich.  Action Categories and the Perception of Biological Motion , 1993, Perception.

[7]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[8]  M. Candidi,et al.  Representation of body identity and body actions in extrastriate body area and ventral premotor cortex , 2007, Nature Neuroscience.

[9]  R. Blake,et al.  Brain activity evoked by inverted and imagined biological motion , 2001, Vision Research.

[10]  A. Kooijman,et al.  Using route and survey information to generate cognitive maps: differences between normally sighted and visually impaired individuals , 2009 .

[11]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[12]  Louise P. Kirsch,et al.  Time perception during apparent biological motion reflects subjective speed of movement, not objective rate of visual stimulation , 2013, Experimental Brain Research.

[13]  C. Heyes,et al.  Motor learning by observation: Evidence from a serial reaction time task , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[14]  Justin N Wood,et al.  When do spatial and visual working memory interact? , 2011, Attention, perception & psychophysics.

[15]  Justin N Wood,et al.  Visual Long-Term Memory Stores High-Fidelity Representations of Observed Actions , 2013, Psychological science.

[16]  P. Haggard,et al.  From Body Form to Biological Motion , 2011, Psychological science.

[17]  N. Kanwisher,et al.  The Human Body , 2001 .

[18]  P. Downing,et al.  The neural basis of visual body perception , 2007, Nature Reviews Neuroscience.

[19]  Alison J. Wiggett,et al.  The role of the extrastriate body area in action perception , 2006, Social neuroscience.

[20]  M. Peelen,et al.  Direct intracranial recording of body-selective responses in human extrastriate visual cortex , 2007, Neuropsychologia.

[21]  J. Freyd,et al.  Timing and Apparent Motion Path Choice With Human Body Photographs , 1993 .

[22]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[23]  Steven J. Luck,et al.  Visual short term memory , 2007, Scholarpedia.

[24]  R. Engle.  Role of Working‐Memory Capacity in Cognitive Control , 2010, Current Anthropology.

[25]  Emily S. Cross,et al.  Contorted and ordinary body postures in the human brain , 2009, Experimental Brain Research.

[26]  Cosimo Urgesi,et al.  Magnetic Stimulation of Extrastriate Body Area Impairs Visual Processing of Nonfacial Body Parts , 2004, Current Biology.

[27]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[28]  Janet Adshead-Lansdale,et al.  Dance analysis : theory and practice , 1988 .

[29]  Leslie G. Ungerleider,et al.  Formation of a Motor Memory by Action Observation , 2005, The Journal of Neuroscience.

[30]  Karl Verfaillie,et al.  Representing and anticipating human actions in vision , 2002 .

[31]  J. Freyd,et al.  Representing the dynamics of a static form , 1983, Memory & cognition.

[32]  Guido Orgs,et al.  Temporal binding during apparent movement of the human body , 2011 .

[33]  Hubert D. Zimmer,et al.  Visual and spatial working memory: From boxes to networks , 2008, Neuroscience & Biobehavioral Reviews.

[34]  C. Rossi-Arnaud,et al.  Working memory for ballet moves and spatial locations in professional ballet dancers , 2010 .

[35]  C. Heyes,et al.  Sequence learning by action, observation and action observation. , 2005, British journal of psychology.

[36]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[37]  Justin N. Wood.  Visual working memory for observed actions. , 2007, Journal of experimental psychology. General.

[38]  Ashleigh M. Richard,et al.  Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. , 2008, Journal of experimental psychology. General.

[39]  Preston P. Thakral,et al.  Memory for motion and spatial location is mediated by contralateral and ipsilateral motion processing cortex , 2011, NeuroImage.

[40]  Markus Huff,et al.  Representation of dynamic spatial configurations in visual short-term memory , 2012, Attention, perception & psychophysics.

[41]  Justin N. Wood.  Visual memory for agents and their actions , 2008, Cognition.

[42]  Irida Mance,et al.  Visual working memory. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[43]  J. Freyd,et al.  Apparent Motion of the Human Body , 1990 .