Parsing activity into meaningful events

People segment ongoing activity into meaningful events, which has important implications for memory and planning. Movement is one basis for segmentation. Perceptual experiments show that movement features are correlated with participants' segmentation of simple events. Neuroimaging data show that regions motion processing regions transiently increase activity at natural event boundaries. The strong relationships between movement and event segmentation may prove helpful for human-robot interaction. It may be possible for computational vision systems to automatically segment ongoing activity into meaningful units, such that those units can be used as the input to algorithms for recognizing the significance of a partner's actions.

[1]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[2]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[3]  Darren Newtson,et al.  The objective basis of behavior units. , 1977 .

[4]  Jeffrey M. Zacks,et al.  Using movement and intentions to understand simple events , 2004, Cogn. Sci..

[5]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[6]  P. Kellman,et al.  From fragments to objects : segmentation and grouping in vision , 2001 .

[7]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[8]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[10]  Yong Rui,et al.  Segmenting visual actions based on spatio-temporal motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Alex Martin,et al.  NEURAL FOUNDATIONS FOR UNDERSTANDING SOCIAL AND MECHANICAL CONCEPTS , 2003, Cognitive neuropsychology.

[12]  P. Todd,et al.  How motion reveals intention: Categorizing social interactions , 1999 .

[13]  D. Heeger,et al.  Spatial attention affects brain activity in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[14]  B. J. Bailey Speech Science Primer: Physiology, Acoustics, and Perception of Speech , 1981 .

[15]  M Boltz,et al.  Temporal accent structure and the remembering of filmed narratives. , 1992, Journal of experimental psychology. Human perception and performance.

[16]  Karl J. Friston,et al.  Attentional modulation of effective connectivity from V2 to V5/MT in humans. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[18]  Jean M. Vettel,et al.  Visual motion and the neural correlates of event perception , 2006, Brain Research.

[19]  F. Hesse,et al.  Do film cuts facilitate the perceptual and cognitive organization of activitiy sequences? , 2000, Memory & cognition.

[20]  Jodie A. Baird,et al.  Infants parse dynamic action. , 2001, Child development.

[21]  Darren Newtson,et al.  The perceptual organization of ongoing behavior , 1976 .

[22]  Y Agid,et al.  Planning and Script Analysis following Prefrontal Lobe Lesions a , 1995, Annals of the New York Academy of Sciences.

[23]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[24]  Jeffery. M. Zacks,et al.  Activation of human motion processing areas during event perception , 2003, Cognitive, affective & behavioral neuroscience.

[25]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.